[ 521.348384] env[65337]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.348384] env[65337]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.334796] env[65427]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.334796] env[65427]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.200025] env[65427]: INFO neutron.common.config [-] Logging enabled! [ 524.200370] env[65427]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev54 [ 524.200500] env[65427]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65427) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.200817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.200911] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.201732] env[65427]: WARNING oslo_policy.policy [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.202028] env[65427]: WARNING oslo_policy.policy [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.203733] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] VMware NSXv3 Agent initialized successfully. [ 524.204102] env[65427]: DEBUG oslo_concurrency.lockutils [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Acquiring lock "singleton_lock" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.204238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Acquired lock "singleton_lock" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.204440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Releasing lock "singleton_lock" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.204731] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Full set of CONF: {{(pid=65427) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.204844] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ******************************************************************************** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.204943] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Configuration options gathered from: {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.205561] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.205743] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.205853] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ================================================================================ {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.206036] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] agent_down_time = 75 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206177] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] allow_automatic_dhcp_failover = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206309] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] allow_bulk = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206448] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] api_extensions_path = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206587] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] api_paste_config = api-paste.ini {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206731] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] auth_strategy = keystone {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206832] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] backdoor_port = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.206935] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] backdoor_socket = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207083] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] backlog = 4096 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207224] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] base_mac = fa:16:3e:00:00:00 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207405] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] bind_host = 0.0.0.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207548] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] bind_port = 9696 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207682] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] client_socket_timeout = 900 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207820] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] config_dir = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.207928] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208078] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] config_source = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208228] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] control_exchange = neutron {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208364] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] core_plugin = ml2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208500] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] debug = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208635] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] default_availability_zones = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208841] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.208978] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dhcp_agent_notification = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209126] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dhcp_agents_per_network = 1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209259] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dhcp_lease_duration = 86400 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209423] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dhcp_load_type = networks {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209567] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dns_domain = openstacklocal {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209702] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209833] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_default_route_bfd = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.209965] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_default_route_ecmp = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210105] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_dvr = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210234] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_new_agents = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210362] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210489] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_signals = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210614] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] enable_traditional_dhcp = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210737] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] external_dns_driver = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.210884] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] filter_validation = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211038] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] global_physnet_mtu = 8950 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211174] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] graceful_shutdown_timeout = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211350] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] host = cpu-1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211485] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] host_dvr_for_dhcp = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211618] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] http_retries = 3 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211756] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] instance_format = [instance: %(uuid)s] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.211964] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212138] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ipam_driver = internal {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212277] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ipv6_pd_enabled = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212407] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] l3_ha = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212543] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212676] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] l3_ha_network_physical_name = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212808] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] l3_ha_network_type = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.212944] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_color = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213091] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_config_append = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213273] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213355] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_dir = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213481] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_file = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213582] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_options = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213714] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_rotate_interval = 1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213851] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_rotate_interval_type = days {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.213987] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] log_rotation_type = none {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214101] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214199] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214334] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214468] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214568] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214700] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_dns_nameservers = 5 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214828] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_header_line = 16384 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.214958] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_l3_agents_per_router = 3 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215097] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_logfile_count = 30 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215225] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_logfile_size_mb = 200 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215351] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] max_subnet_host_routes = 20 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215483] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] my_ip = 10.180.1.21 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215614] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] my_ipv6 = ::1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215741] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] network_auto_schedule = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.215866] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] network_link_prefix = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216030] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216180] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] notify_nova_on_port_data_changes = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216307] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] notify_nova_on_port_status_changes = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216443] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] pagination_max_limit = -1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216570] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] publish_errors = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216699] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rate_limit_burst = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216833] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rate_limit_except_level = CRITICAL {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.216963] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rate_limit_interval = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217102] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] retry_until_window = 30 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217229] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] router_distributed = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217358] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rpc_resources_processing_step = 20 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217485] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rpc_response_max_timeout = 600 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217614] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] rpc_response_timeout = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217743] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] send_events_interval = 2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.217889] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] service_plugins = ['router'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218040] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] setproctitle = on {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218169] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] shell_completion = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218305] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] state_path = /opt/stack/data/neutron {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218440] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] syslog_log_facility = LOG_USER {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218570] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] tcp_keepidle = 600 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218703] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] transport_url = **** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218831] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] use_journal = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.218960] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] use_json = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219098] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] use_ssl = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219225] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] use_stderr = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219359] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] use_syslog = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219487] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vlan_qinq = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219613] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vlan_transparent = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219741] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] watch_log_file = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219871] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] wsgi_default_pool_size = 100 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.219999] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] wsgi_keep_alive = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.220148] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.220324] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] wsgi_server_debug = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.220488] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_concurrency.disable_process_locking = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.220665] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.220803] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.220948] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221103] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221243] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221380] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221530] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.connection_string = messaging:// {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221668] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.enabled = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221809] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.es_doc_type = notification {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.221945] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.es_scroll_size = 10000 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222094] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.es_scroll_time = 2m {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222226] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.filter_error_trace = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222362] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.hmac_keys = **** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222498] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.sentinel_service_name = mymaster {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222640] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.socket_timeout = 0.1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222769] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.trace_requests = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.222901] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler.trace_sqlalchemy = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.223057] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler_jaeger.process_tags = {} {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.223191] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler_jaeger.service_name_prefix = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.223321] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] profiler_otlp.service_name_prefix = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.223466] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.enforce_new_defaults = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.223741] env[65427]: WARNING oslo_config.cfg [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.223891] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.enforce_scope = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224053] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.policy_default_rule = default {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224206] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224347] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224488] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224621] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224751] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.224881] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225025] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225169] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_policy.remote_timeout = 60.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225316] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225458] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] agent.extensions = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225597] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225738] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] service_providers.service_provider = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.225879] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.default_quota = -1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226035] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226169] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_floatingip = 50 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226303] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_network = 100 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226435] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_port = 500 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226565] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226694] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_router = 10 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226825] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_security_group = 10 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.226958] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227100] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.quota_subnet = 100 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227234] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] QUOTAS.track_quota_usage = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227379] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227511] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227639] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227770] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.227907] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228052] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228184] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228323] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228452] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228579] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228714] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.228863] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229009] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229152] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_dhcp_release.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229286] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229411] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229538] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229670] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229803] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.229935] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230072] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_ovs_vsctl.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230211] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.capabilities = [21] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230338] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230465] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230593] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230728] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.230887] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231042] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_namespace.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231184] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.capabilities = [12] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231328] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231494] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231634] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231778] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.231914] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232057] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_conntrack.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232202] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.capabilities = [12, 21] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232331] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.group = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232458] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.helper_command = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232590] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.log_daemon_traceback = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232728] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232860] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.thread_pool_size = 8 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.232989] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] privsep_link.user = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.233153] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.233429] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.233574] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.continue_on_failed_promotions = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.233709] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.dscp = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.233841] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.dscp_inherit = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234075] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.force_mp_to_policy = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234228] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.locking_coordinator_url = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234366] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.log_agent_heartbeats = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234499] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.logging_expire = 1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234641] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234776] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.234919] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.polling_interval = 240 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235064] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235206] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235348] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.report_interval = 30.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235488] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235626] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235764] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.235901] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.sync_skew = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236041] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.synchronization_queue_size = 20 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236175] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT.use_helper_for_ns_read = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236315] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] SECURITYGROUP.enable_ipset = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236454] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] SECURITYGROUP.enable_security_group = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236591] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236727] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.236879] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] experimental.ipv6_pd_enabled = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237033] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.extension_drivers = ['port_security'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237169] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.external_network_type = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237317] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237459] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.overlay_ip_version = 4 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237596] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.path_mtu = 8950 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237733] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.physical_network_mtus = {} {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.237877] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.tenant_network_types = ['vlan'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238027] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238173] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ml2.type_drivers = ['vlan'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238314] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT_CLI.neutron_port_id = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238446] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238578] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238720] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.238896] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239069] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239212] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239364] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239487] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239678] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239824] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_login_password = **** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.239976] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_login_port = 443 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240125] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_login_user = admin {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240263] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240404] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240537] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240668] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240837] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.240987] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241140] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241280] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241416] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241552] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241692] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.241830] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.242016] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vsphere.vsphere_login_password = VMware1! {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.auth_section = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243235] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.auth_type = password {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243474] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243474] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.certfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243474] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.collect_timing = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243474] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.endpoint_type = public {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243604] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.insecure = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243667] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.keyfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243814] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.region_name = RegionOne {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.243941] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.split_loggers = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244081] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] nova.timeout = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244219] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.auth_section = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244362] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.auth_type = password {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244500] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244632] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.certfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244765] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.collect_timing = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.244905] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.endpoint_type = public {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245045] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.insecure = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245175] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.keyfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245300] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.region_name = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245431] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.split_loggers = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245573] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] placement.timeout = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.245801] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.auth_section = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.246030] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.auth_type = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.246248] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.cafile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.246475] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.certfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.246712] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.collect_timing = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.246955] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.connect_retries = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247208] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.connect_retry_delay = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247413] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.enable_notifications = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247564] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.endpoint_override = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247708] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.insecure = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247842] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.interface = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.247976] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.keyfile = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248439] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.max_version = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248439] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.min_version = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248439] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.region_name = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248549] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.retriable_status_codes = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248616] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.service_name = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248743] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.service_type = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.248874] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.split_loggers = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249309] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.status_code_retries = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249309] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.status_code_retry_delay = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249309] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.timeout = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249437] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.valid_interfaces = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249503] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ironic.version = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249662] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] cli_script.dry_run = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249785] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.249917] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250059] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250194] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250326] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250456] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250586] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250718] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.250881] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251035] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251168] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251310] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251450] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251589] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251724] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.251867] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252008] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252148] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252285] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252418] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252552] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252685] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252817] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.252951] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253093] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253227] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253426] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253587] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253723] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.253859] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254033] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254152] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254290] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254422] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254558] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.254696] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.ssl_version = {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255077] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255077] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_notifications.driver = [] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255154] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_notifications.retry = -1 {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255248] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255379] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] oslo_messaging_notifications.transport_url = **** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.255483] env[65427]: DEBUG oslo_service.backend._eventlet.service [None req-8b5bc850-cf77-42bf-a6a9-29318f0b363c None None] ******************************************************************************** {{(pid=65427) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.256608] env[65427]: DEBUG neutron.agent.securitygroups_rpc [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Init firewall settings (driver=nsxv3) {{(pid=65427) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.257944] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65427) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.258205] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.260453] env[65427]: DEBUG dogpile.cache.region [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.260584] env[65427]: DEBUG dogpile.lock [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.260683] env[65427]: DEBUG dogpile.lock [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.260817] env[65427]: DEBUG dogpile.lock [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.260922] env[65427]: DEBUG dogpile.cache.region [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.260987] env[65427]: DEBUG dogpile.lock [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.261109] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.280374] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Session token - acquiring [ 524.282332] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.282616] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.282746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.283286] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.294713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.593149] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.627506] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.627727] env[65427]: DEBUG dogpile.cache.region [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Cache value generated in 0.367 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.627785] env[65427]: DEBUG dogpile.lock [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.627905] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Activating Policy API Provider. [ 524.628202] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Looking for the default Infrastructure Rules. [ 524.697591] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Looking for the Default Layer3 Logged Drop Section. [ 524.717214] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.717707] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.717885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.717989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.718296] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.718644] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.234402] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.736722] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.240236] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Inventory metadata is going to be refreshed. [ 526.240628] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.054780] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.055064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.055064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.055391] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.066340] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.067248] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.068097] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.086577] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.086782] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.086899] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.087176] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.087318] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.087464] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.087575] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.087679] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.109703] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.109994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.110220] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.110344] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.110518] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.110662] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.132278] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.132499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.132645] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.132879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.133035] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.133184] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.155840] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.156151] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.156151] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.156441] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.156583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.156731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.156836] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.156940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.175424] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.175672] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.175716] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.175999] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.176141] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.176281] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.176386] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.176488] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.200072] env[65427]: DEBUG networking_nsxv3.common.locking [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.200291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.200438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.200692] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.200852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.201030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.201166] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.201274] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Inventory metadata have been refreshed. [ 527.201376] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Dryrun:True. Metadata refresh completed. [ 527.201499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.203236] env[65427]: INFO neutron.agent.agent_extensions_manager [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Loaded agent extensions: [] [ 527.203940] env[65427]: DEBUG neutron_lib.callbacks.manager [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65427) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.265641] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.266062] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.266062] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent out of sync with plugin! [ 532.206543] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.206543] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.206053] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.206745] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.877948] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3ac99b7e-6108-4780-bf65-4a499a2645fc demo admin] Enqueued Resource ID: 5dead877-4499-4951-bbd2-cb5bc15c4565 with Priority: HIGHEST for action security_group_rules [ 541.878706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dead877-4499-4951-bbd2-cb5bc15c4565 with Priority: HIGHEST for action security_group_rules [ 541.879018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dead877-4499-4951-bbd2-cb5bc15c4565 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.879293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dead877-4499-4951-bbd2-cb5bc15c4565" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.879388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dead877-4499-4951-bbd2-cb5bc15c4565" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.879726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dead877-4499-4951-bbd2-cb5bc15c4565" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.879819] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dead877-4499-4951-bbd2-cb5bc15c4565',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.402017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.402017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.402017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.402017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.402017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.402017] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dead877-4499-4951-bbd2-cb5bc15c4565 already deleted. [ 542.402017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dead877-4499-4951-bbd2-cb5bc15c4565" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.879501] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.879858] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.881524] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.881524] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.208122] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.208122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.208122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.208122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.208663] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.710963] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.213642] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.716248] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 555.716436] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 556.481729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.482218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.482218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.482218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.494746] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 556.495897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.496518] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 556.513404] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.513632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.513632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.514527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.514527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.514527] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 556.514527] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.514527] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 556.532341] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.532534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.532534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.532743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.532878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.532983] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 556.552293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.552496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.552538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.552721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.552828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.552935] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 556.574751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.574985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.574985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.575168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.575275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.575422] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 556.575488] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.575537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 556.593591] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.593854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.593854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.594065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.594157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.594267] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 556.594341] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.594415] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 556.615631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.615905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.615905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.616040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.616170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.616291] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 556.616380] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 556.616451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 556.616524] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 556.616591] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 556.616658] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 556.616658] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 556.616957] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 556.617042] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 556.617114] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 556.636043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.636295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.636295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.636445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.636584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.636702] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 556.656166] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.656399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.656399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.656560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.656664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.669525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.882459] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.882711] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.883874] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.883874] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.885249] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.885644] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.643169] env[65427]: INFO networking_nsxv3.common.synchronization [None req-392a06f7-38b3-401a-b0f2-0281a326f977 None None] Enqueued Resource ID: 5ff0007b-5679-4638-b117-1a58007005db with Priority: HIGHEST for action port [ 571.644047] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff0007b-5679-4638-b117-1a58007005db with Priority: HIGHEST for action port [ 571.644047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff0007b-5679-4638-b117-1a58007005db taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.644372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff0007b-5679-4638-b117-1a58007005db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.644372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff0007b-5679-4638-b117-1a58007005db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.644780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff0007b-5679-4638-b117-1a58007005db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.645295] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff0007b-5679-4638-b117-1a58007005db',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.147722] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ff0007b-5679-4638-b117-1a58007005db [ 572.149502] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.149502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.149502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.149502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.149502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.149502] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ff0007b-5679-4638-b117-1a58007005db already deleted. [ 572.149502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff0007b-5679-4638-b117-1a58007005db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.919234] env[65427]: INFO networking_nsxv3.common.synchronization [None req-6b90714e-bc6d-481f-9333-30542a258ec0 None None] Enqueued Resource ID: 2813a732-e836-47c0-a297-e577db9eba76 with Priority: HIGHEST for action port [ 573.919234] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2813a732-e836-47c0-a297-e577db9eba76 with Priority: HIGHEST for action port [ 573.920868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2813a732-e836-47c0-a297-e577db9eba76 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.920868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2813a732-e836-47c0-a297-e577db9eba76" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.920868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2813a732-e836-47c0-a297-e577db9eba76" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.921405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2813a732-e836-47c0-a297-e577db9eba76" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.921405] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2813a732-e836-47c0-a297-e577db9eba76',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.423800] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2813a732-e836-47c0-a297-e577db9eba76 [ 574.424060] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.424221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.424960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.424960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.424960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.424960] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2813a732-e836-47c0-a297-e577db9eba76 already deleted. [ 574.424960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2813a732-e836-47c0-a297-e577db9eba76" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.604971] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2bdabbd8-8730-4ce5-b209-f1b53680ed68 None None] Enqueued Resource ID: 78075ef3-54f4-4aba-b626-7a782183df60 with Priority: HIGHEST for action port [ 574.605516] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78075ef3-54f4-4aba-b626-7a782183df60 with Priority: HIGHEST for action port [ 574.605811] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-78075ef3-54f4-4aba-b626-7a782183df60 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.605931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78075ef3-54f4-4aba-b626-7a782183df60" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.606011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78075ef3-54f4-4aba-b626-7a782183df60" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.606316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78075ef3-54f4-4aba-b626-7a782183df60" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.606422] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78075ef3-54f4-4aba-b626-7a782183df60',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.108696] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78075ef3-54f4-4aba-b626-7a782183df60 [ 575.109036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.109103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.109160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.109384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.109496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.109584] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78075ef3-54f4-4aba-b626-7a782183df60 already deleted. [ 575.109984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78075ef3-54f4-4aba-b626-7a782183df60" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.524206] env[65427]: INFO networking_nsxv3.common.synchronization [None req-bdb13d23-789a-41c4-9e1f-be494f481008 None None] Enqueued Resource ID: c509c5e5-99a0-45d3-a66c-3dae318efa1e with Priority: HIGHEST for action port [ 575.524206] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c509c5e5-99a0-45d3-a66c-3dae318efa1e with Priority: HIGHEST for action port [ 575.524206] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c509c5e5-99a0-45d3-a66c-3dae318efa1e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.524206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c509c5e5-99a0-45d3-a66c-3dae318efa1e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.524206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c509c5e5-99a0-45d3-a66c-3dae318efa1e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.528420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c509c5e5-99a0-45d3-a66c-3dae318efa1e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.528420] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c509c5e5-99a0-45d3-a66c-3dae318efa1e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.031032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c509c5e5-99a0-45d3-a66c-3dae318efa1e [ 576.031233] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.031380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.031451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.031689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.031787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.031879] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c509c5e5-99a0-45d3-a66c-3dae318efa1e already deleted. [ 576.031961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c509c5e5-99a0-45d3-a66c-3dae318efa1e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.186756] env[65427]: INFO networking_nsxv3.common.synchronization [None req-360de093-2d4c-4d5d-b0ba-faecd0684916 None None] Enqueued Resource ID: 4d89af2e-43b6-4de7-af33-2c6c2c208eea with Priority: HIGHEST for action port [ 576.191036] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d89af2e-43b6-4de7-af33-2c6c2c208eea with Priority: HIGHEST for action port [ 576.191036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d89af2e-43b6-4de7-af33-2c6c2c208eea taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.191036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d89af2e-43b6-4de7-af33-2c6c2c208eea" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.191036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d89af2e-43b6-4de7-af33-2c6c2c208eea" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.191036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d89af2e-43b6-4de7-af33-2c6c2c208eea" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.191036] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d89af2e-43b6-4de7-af33-2c6c2c208eea',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.345255] env[65427]: INFO networking_nsxv3.common.synchronization [None req-487fce2a-4263-4f34-b732-52b4fe0cbe11 None None] Enqueued Resource ID: 0970e107-c790-4bc6-8941-8318118b438f with Priority: HIGHEST for action port [ 576.345501] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0970e107-c790-4bc6-8941-8318118b438f with Priority: HIGHEST for action port [ 576.346192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0970e107-c790-4bc6-8941-8318118b438f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.346279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0970e107-c790-4bc6-8941-8318118b438f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.346385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0970e107-c790-4bc6-8941-8318118b438f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.346620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0970e107-c790-4bc6-8941-8318118b438f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.346697] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0970e107-c790-4bc6-8941-8318118b438f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.692316] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d89af2e-43b6-4de7-af33-2c6c2c208eea [ 576.692548] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.692684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.692747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.693023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.693206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.693280] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d89af2e-43b6-4de7-af33-2c6c2c208eea already deleted. [ 576.694027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d89af2e-43b6-4de7-af33-2c6c2c208eea" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.852104] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0970e107-c790-4bc6-8941-8318118b438f [ 576.852104] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.852104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.852104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.852104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.852104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.852104] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0970e107-c790-4bc6-8941-8318118b438f already deleted. [ 576.852104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0970e107-c790-4bc6-8941-8318118b438f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.772465] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9cad12f9-7054-456d-9c75-5a79e8ca520d None None] Enqueued Resource ID: c42614d6-5080-4add-b490-eaa8ac90ebbf with Priority: HIGHEST for action port [ 578.774648] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42614d6-5080-4add-b490-eaa8ac90ebbf with Priority: HIGHEST for action port [ 578.776768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c42614d6-5080-4add-b490-eaa8ac90ebbf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.776768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c42614d6-5080-4add-b490-eaa8ac90ebbf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.776768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c42614d6-5080-4add-b490-eaa8ac90ebbf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.776768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c42614d6-5080-4add-b490-eaa8ac90ebbf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.776768] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c42614d6-5080-4add-b490-eaa8ac90ebbf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.281024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c42614d6-5080-4add-b490-eaa8ac90ebbf [ 579.281024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.281024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.281024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.281024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.281024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.281024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c42614d6-5080-4add-b490-eaa8ac90ebbf already deleted. [ 579.281024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c42614d6-5080-4add-b490-eaa8ac90ebbf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.338729] env[65427]: INFO networking_nsxv3.common.synchronization [None req-41ec8d73-b8df-4927-97c4-2e379cc5bb8c None None] Enqueued Resource ID: a231035c-5d81-4b6f-b278-517b722271f8 with Priority: HIGHEST for action port [ 579.340260] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a231035c-5d81-4b6f-b278-517b722271f8 with Priority: HIGHEST for action port [ 579.340260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a231035c-5d81-4b6f-b278-517b722271f8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.340260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a231035c-5d81-4b6f-b278-517b722271f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.340260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a231035c-5d81-4b6f-b278-517b722271f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.340786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a231035c-5d81-4b6f-b278-517b722271f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.340899] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a231035c-5d81-4b6f-b278-517b722271f8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.844836] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a231035c-5d81-4b6f-b278-517b722271f8 [ 579.845128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.845201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.845201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.845851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.845851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.845851] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a231035c-5d81-4b6f-b278-517b722271f8 already deleted. [ 579.845851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a231035c-5d81-4b6f-b278-517b722271f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.173847] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f6fea2eb-fb5c-4711-989b-d2e2cb35159d None None] Enqueued Resource ID: bb1cff2a-132b-4257-8e3b-2a048321f007 with Priority: HIGHEST for action port [ 580.173847] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1cff2a-132b-4257-8e3b-2a048321f007 with Priority: HIGHEST for action port [ 580.173847] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb1cff2a-132b-4257-8e3b-2a048321f007 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.173847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb1cff2a-132b-4257-8e3b-2a048321f007" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.173847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb1cff2a-132b-4257-8e3b-2a048321f007" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.173847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb1cff2a-132b-4257-8e3b-2a048321f007" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.173847] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1cff2a-132b-4257-8e3b-2a048321f007',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.676252] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb1cff2a-132b-4257-8e3b-2a048321f007 [ 580.680691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.680691] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb1cff2a-132b-4257-8e3b-2a048321f007 already deleted. [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb1cff2a-132b-4257-8e3b-2a048321f007" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.680691] env[65427]: INFO networking_nsxv3.common.synchronization [None req-e82b11cf-d78a-443c-9622-a8cd904fc525 None None] Enqueued Resource ID: 16001679-d5bc-4af6-9458-49a75b336011 with Priority: HIGHEST for action port [ 580.680691] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16001679-d5bc-4af6-9458-49a75b336011 with Priority: HIGHEST for action port [ 580.680691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-16001679-d5bc-4af6-9458-49a75b336011 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16001679-d5bc-4af6-9458-49a75b336011" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16001679-d5bc-4af6-9458-49a75b336011" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.680691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16001679-d5bc-4af6-9458-49a75b336011" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.680691] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16001679-d5bc-4af6-9458-49a75b336011',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.183150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16001679-d5bc-4af6-9458-49a75b336011 [ 581.183483] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.183828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.183908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.184172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.184266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.184364] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16001679-d5bc-4af6-9458-49a75b336011 already deleted. [ 581.184445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16001679-d5bc-4af6-9458-49a75b336011" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.561190] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f14b4683-a17f-4473-bc72-46927e492397 None None] Enqueued Resource ID: 1bf332ef-e3f4-4d13-af4c-56fdf6082ec0 with Priority: HIGHEST for action port [ 581.562055] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf332ef-e3f4-4d13-af4c-56fdf6082ec0 with Priority: HIGHEST for action port [ 581.562055] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bf332ef-e3f4-4d13-af4c-56fdf6082ec0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.562241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bf332ef-e3f4-4d13-af4c-56fdf6082ec0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.562241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bf332ef-e3f4-4d13-af4c-56fdf6082ec0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.562430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bf332ef-e3f4-4d13-af4c-56fdf6082ec0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.562508] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf332ef-e3f4-4d13-af4c-56fdf6082ec0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.898929] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b2ec3b3d-afe3-42e8-8b7c-737529a49567 None None] Enqueued Resource ID: 76d5dc49-449f-4619-9a27-20e05ac203b8 with Priority: HIGHEST for action port [ 581.902603] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d5dc49-449f-4619-9a27-20e05ac203b8 with Priority: HIGHEST for action port [ 581.903277] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-76d5dc49-449f-4619-9a27-20e05ac203b8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.903397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76d5dc49-449f-4619-9a27-20e05ac203b8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.903479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76d5dc49-449f-4619-9a27-20e05ac203b8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.904050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76d5dc49-449f-4619-9a27-20e05ac203b8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.904050] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76d5dc49-449f-4619-9a27-20e05ac203b8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.066122] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bf332ef-e3f4-4d13-af4c-56fdf6082ec0 [ 582.068878] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.068878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.068878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.068878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.068878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.068878] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bf332ef-e3f4-4d13-af4c-56fdf6082ec0 already deleted. [ 582.068878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bf332ef-e3f4-4d13-af4c-56fdf6082ec0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.407537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76d5dc49-449f-4619-9a27-20e05ac203b8 [ 582.407537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.407537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.407537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.407537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.407537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.407537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76d5dc49-449f-4619-9a27-20e05ac203b8 already deleted. [ 582.407537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76d5dc49-449f-4619-9a27-20e05ac203b8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.149698] env[65427]: INFO networking_nsxv3.common.synchronization [None req-1f63cae7-da03-4b89-aff0-598d2ba343b9 None None] Enqueued Resource ID: bc43495c-0a80-4d03-ae62-2fc646c451ee with Priority: HIGHEST for action port [ 583.149698] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc43495c-0a80-4d03-ae62-2fc646c451ee with Priority: HIGHEST for action port [ 583.149877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc43495c-0a80-4d03-ae62-2fc646c451ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.150025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc43495c-0a80-4d03-ae62-2fc646c451ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.150083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc43495c-0a80-4d03-ae62-2fc646c451ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.151185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc43495c-0a80-4d03-ae62-2fc646c451ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.151415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc43495c-0a80-4d03-ae62-2fc646c451ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.241021] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2f314ad0-b983-4bc3-89b3-57105221fd6d None None] Enqueued Resource ID: b744c978-6ad2-4cb5-957b-4ca443aebae6 with Priority: HIGHEST for action port [ 583.241021] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b744c978-6ad2-4cb5-957b-4ca443aebae6 with Priority: HIGHEST for action port [ 583.241021] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b744c978-6ad2-4cb5-957b-4ca443aebae6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.241021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b744c978-6ad2-4cb5-957b-4ca443aebae6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.241021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b744c978-6ad2-4cb5-957b-4ca443aebae6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.241021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b744c978-6ad2-4cb5-957b-4ca443aebae6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.241021] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b744c978-6ad2-4cb5-957b-4ca443aebae6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.654734] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc43495c-0a80-4d03-ae62-2fc646c451ee [ 583.654734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.654734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.655052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.655052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.656017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.656017] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc43495c-0a80-4d03-ae62-2fc646c451ee already deleted. [ 583.656017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc43495c-0a80-4d03-ae62-2fc646c451ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.743207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b744c978-6ad2-4cb5-957b-4ca443aebae6 [ 583.743481] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.744099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.744516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.744775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.745538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.745674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b744c978-6ad2-4cb5-957b-4ca443aebae6 already deleted. [ 583.745809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b744c978-6ad2-4cb5-957b-4ca443aebae6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.243615] env[65427]: INFO networking_nsxv3.common.synchronization [None req-068ae86d-f21e-4b92-b5bc-90c2bd9ba16d None None] Enqueued Resource ID: 253b4d11-7a97-45ee-8eb2-a2558d7523e2 with Priority: HIGHEST for action port [ 585.243896] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 253b4d11-7a97-45ee-8eb2-a2558d7523e2 with Priority: HIGHEST for action port [ 585.244463] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-253b4d11-7a97-45ee-8eb2-a2558d7523e2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.244589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-253b4d11-7a97-45ee-8eb2-a2558d7523e2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.244659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-253b4d11-7a97-45ee-8eb2-a2558d7523e2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.244900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-253b4d11-7a97-45ee-8eb2-a2558d7523e2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.245013] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('253b4d11-7a97-45ee-8eb2-a2558d7523e2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.749065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 253b4d11-7a97-45ee-8eb2-a2558d7523e2 [ 585.749065] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.749065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.749065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.750211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.750312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.750421] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:253b4d11-7a97-45ee-8eb2-a2558d7523e2 already deleted. [ 585.750501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-253b4d11-7a97-45ee-8eb2-a2558d7523e2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.222673] env[65427]: INFO networking_nsxv3.common.synchronization [None req-33acdf28-3850-4aa0-8607-aafd491004f5 None None] Enqueued Resource ID: 2985ed53-3762-425e-a09f-4585aa0c3913 with Priority: HIGHEST for action port [ 586.226750] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2985ed53-3762-425e-a09f-4585aa0c3913 with Priority: HIGHEST for action port [ 586.226750] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2985ed53-3762-425e-a09f-4585aa0c3913 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.226750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2985ed53-3762-425e-a09f-4585aa0c3913" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.226750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2985ed53-3762-425e-a09f-4585aa0c3913" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.226750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2985ed53-3762-425e-a09f-4585aa0c3913" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.226750] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2985ed53-3762-425e-a09f-4585aa0c3913',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.730032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2985ed53-3762-425e-a09f-4585aa0c3913 [ 586.730032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.730032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.730432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.730432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.730578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.730721] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2985ed53-3762-425e-a09f-4585aa0c3913 already deleted. [ 586.730845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2985ed53-3762-425e-a09f-4585aa0c3913" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.904629] env[65427]: INFO networking_nsxv3.common.synchronization [req-208a0e61-6617-4002-85dc-8a8c060f1bdc req-f7feeb10-b840-4a4a-be93-b3bff1671f88 tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: 237260ff-779a-4008-aaee-64e48f197838 with Priority: HIGHEST for action security_group_rules [ 587.907866] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237260ff-779a-4008-aaee-64e48f197838 with Priority: HIGHEST for action security_group_rules [ 587.907866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-237260ff-779a-4008-aaee-64e48f197838 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.908044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-237260ff-779a-4008-aaee-64e48f197838" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.908044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-237260ff-779a-4008-aaee-64e48f197838" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.908397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-237260ff-779a-4008-aaee-64e48f197838" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.908528] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('237260ff-779a-4008-aaee-64e48f197838',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.432488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.432634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.432711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.432959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.433061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.433158] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 237260ff-779a-4008-aaee-64e48f197838 already deleted. [ 588.433244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-237260ff-779a-4008-aaee-64e48f197838" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.565522] env[65427]: INFO networking_nsxv3.common.synchronization [None req-94343712-bbdf-4663-a17c-bf12cdf461a7 None None] Enqueued Resource ID: c304b594-2b3f-42af-b2ee-c5b3d517ace4 with Priority: HIGHEST for action port [ 588.566069] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c304b594-2b3f-42af-b2ee-c5b3d517ace4 with Priority: HIGHEST for action port [ 588.566376] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c304b594-2b3f-42af-b2ee-c5b3d517ace4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.566495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c304b594-2b3f-42af-b2ee-c5b3d517ace4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.566564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c304b594-2b3f-42af-b2ee-c5b3d517ace4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.566817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c304b594-2b3f-42af-b2ee-c5b3d517ace4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.566903] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c304b594-2b3f-42af-b2ee-c5b3d517ace4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.069417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c304b594-2b3f-42af-b2ee-c5b3d517ace4 [ 589.069767] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.069839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.069877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.070964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.070964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.070964] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c304b594-2b3f-42af-b2ee-c5b3d517ace4 already deleted. [ 589.071149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c304b594-2b3f-42af-b2ee-c5b3d517ace4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.487014] env[65427]: INFO networking_nsxv3.common.synchronization [None req-e21d0fc3-f357-4c92-93f1-776ba9fa4441 None None] Enqueued Resource ID: 20bd35cb-d878-4884-905d-a2ea172cbdf2 with Priority: HIGHEST for action port [ 589.489935] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bd35cb-d878-4884-905d-a2ea172cbdf2 with Priority: HIGHEST for action port [ 589.489935] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bd35cb-d878-4884-905d-a2ea172cbdf2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.489935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bd35cb-d878-4884-905d-a2ea172cbdf2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.489935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bd35cb-d878-4884-905d-a2ea172cbdf2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.489935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bd35cb-d878-4884-905d-a2ea172cbdf2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.489935] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bd35cb-d878-4884-905d-a2ea172cbdf2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.992951] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20bd35cb-d878-4884-905d-a2ea172cbdf2 [ 589.992951] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.992951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.992951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.992951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.992951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.992951] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20bd35cb-d878-4884-905d-a2ea172cbdf2 already deleted. [ 589.992951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bd35cb-d878-4884-905d-a2ea172cbdf2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.053608] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5f899371-2b99-4f4c-93fa-3468f36a262b None None] Enqueued Resource ID: ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4 with Priority: HIGHEST for action port [ 590.054232] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4 with Priority: HIGHEST for action port [ 590.054474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.054701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.054786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.055241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.055241] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.465789] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4738e7a0-1978-45ce-ba4f-640d224e6d3c None None] Enqueued Resource ID: 12d16680-6af2-4445-81f6-da6ca2cc05ef with Priority: HIGHEST for action port [ 590.466368] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d16680-6af2-4445-81f6-da6ca2cc05ef with Priority: HIGHEST for action port [ 590.466664] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d16680-6af2-4445-81f6-da6ca2cc05ef taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.466798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d16680-6af2-4445-81f6-da6ca2cc05ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.466861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d16680-6af2-4445-81f6-da6ca2cc05ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.470783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d16680-6af2-4445-81f6-da6ca2cc05ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.470783] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d16680-6af2-4445-81f6-da6ca2cc05ef',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.557427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4 [ 590.557675] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.557809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.557874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.558172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.558273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.558428] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4 already deleted. [ 590.558487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab02fb53-71fc-41c1-8c8f-3fe6a35a70b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.929240] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7e1cac57-c951-458c-b390-dd1bec0cd4e6 None None] Enqueued Resource ID: c6d450cc-1a6b-414e-a40c-5641aaeb040a with Priority: HIGHEST for action port [ 590.929240] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d450cc-1a6b-414e-a40c-5641aaeb040a with Priority: HIGHEST for action port [ 590.931845] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6d450cc-1a6b-414e-a40c-5641aaeb040a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.931845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6d450cc-1a6b-414e-a40c-5641aaeb040a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.931845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6d450cc-1a6b-414e-a40c-5641aaeb040a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.931845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6d450cc-1a6b-414e-a40c-5641aaeb040a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.931845] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6d450cc-1a6b-414e-a40c-5641aaeb040a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.976557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12d16680-6af2-4445-81f6-da6ca2cc05ef [ 590.976557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.976557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.976557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.976557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.976557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.976557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12d16680-6af2-4445-81f6-da6ca2cc05ef already deleted. [ 590.976557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d16680-6af2-4445-81f6-da6ca2cc05ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.435499] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6d450cc-1a6b-414e-a40c-5641aaeb040a [ 591.436100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.436100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.436100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.436100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.436100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.436307] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6d450cc-1a6b-414e-a40c-5641aaeb040a already deleted. [ 591.436307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6d450cc-1a6b-414e-a40c-5641aaeb040a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.729986] env[65427]: INFO networking_nsxv3.common.synchronization [None req-84338304-6e6b-471a-8854-ca05b036eeae None None] Enqueued Resource ID: a48a64f5-92dd-4127-a99c-02c7cc2fc057 with Priority: HIGHEST for action port [ 591.731411] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48a64f5-92dd-4127-a99c-02c7cc2fc057 with Priority: HIGHEST for action port [ 591.731872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a48a64f5-92dd-4127-a99c-02c7cc2fc057 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.732009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a48a64f5-92dd-4127-a99c-02c7cc2fc057" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.732062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a48a64f5-92dd-4127-a99c-02c7cc2fc057" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.733535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a48a64f5-92dd-4127-a99c-02c7cc2fc057" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.733535] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a48a64f5-92dd-4127-a99c-02c7cc2fc057',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.236768] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a48a64f5-92dd-4127-a99c-02c7cc2fc057 [ 592.236768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.236768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.236768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.236768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.236768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.236768] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a48a64f5-92dd-4127-a99c-02c7cc2fc057 already deleted. [ 592.236768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a48a64f5-92dd-4127-a99c-02c7cc2fc057" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.402318] env[65427]: INFO networking_nsxv3.common.synchronization [None req-db0f6ed3-9d0e-435f-941c-a6601c42661c None None] Enqueued Resource ID: 12cfa18c-cb22-46b2-9dfb-c299b31ec122 with Priority: HIGHEST for action port [ 592.402318] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12cfa18c-cb22-46b2-9dfb-c299b31ec122 with Priority: HIGHEST for action port [ 592.402318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-12cfa18c-cb22-46b2-9dfb-c299b31ec122 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.402318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12cfa18c-cb22-46b2-9dfb-c299b31ec122" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.402318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12cfa18c-cb22-46b2-9dfb-c299b31ec122" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.402318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12cfa18c-cb22-46b2-9dfb-c299b31ec122" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.402318] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12cfa18c-cb22-46b2-9dfb-c299b31ec122',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.451209] env[65427]: INFO networking_nsxv3.common.synchronization [None req-db8ec5b8-9fc1-4f79-abbe-66c23c376dac tempest-VolumesAssistedSnapshotsTest-2048674847 tempest-VolumesAssistedSnapshotsTest-2048674847-project-member] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 592.451724] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 592.452295] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.452295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.452295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.452540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.452607] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.720141] env[65427]: INFO networking_nsxv3.common.synchronization [req-aa10e074-30df-4fcb-a444-ace7a65faa3b req-52fb5fde-4b41-406e-b3d6-0770f2a12b23 tempest-DeleteServersAdminTestJSON-1806482241 tempest-DeleteServersAdminTestJSON-1806482241-project-member] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 592.721043] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 592.721043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.721966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.722070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.722323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.722520] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.722624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.722664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.722828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.722935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.723048] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.773152] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f9501d6c-9f99-4c6b-bf65-3dcd027b3cd8 tempest-VolumesAssistedSnapshotsTest-2048674847 tempest-VolumesAssistedSnapshotsTest-2048674847-project-member] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 592.773152] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 592.773152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.773152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.906894] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12cfa18c-cb22-46b2-9dfb-c299b31ec122 [ 592.906894] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.906894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.906894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.906894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.906894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.906894] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12cfa18c-cb22-46b2-9dfb-c299b31ec122 already deleted. [ 592.906894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12cfa18c-cb22-46b2-9dfb-c299b31ec122" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.977040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.977609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.977755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.978144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.978958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.979182] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008bf551-bcd7-451b-8250-579db77bad7d already deleted. [ 592.979352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.979662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.979964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.980183] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.139638] env[65427]: INFO networking_nsxv3.common.synchronization [req-a52213e8-adbf-49c0-94b2-1776736d6a49 req-4984db55-a180-48c1-8033-a465d3ff40c4 tempest-ServerDiagnosticsNegativeTest-1656538749 tempest-ServerDiagnosticsNegativeTest-1656538749-project-member] Enqueued Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 593.143011] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 593.143011] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.143011] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.143011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.143011] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.224934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.225182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.225239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.225438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.225529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.225793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.225915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.225981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.226388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.226466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.226701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee already deleted. [ 593.226823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.505868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.506053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.506101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.506350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.506424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.507686] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008bf551-bcd7-451b-8250-579db77bad7d already deleted. [ 593.507686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.644379] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.644574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.644634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.644823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.645067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.645122] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.645213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.645278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.645463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.645525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.645582] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 already deleted. [ 593.645659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.260934] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.261978] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.261978] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.262440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.262689] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.267027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.267027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.267027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.267027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.267027] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.267027] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.267027] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.267027] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.267027] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.267027] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.267027] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.288734] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.289157] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.289231] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.289528] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.289896] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-63db7f7d-023b-451a-b28e-b24533d21812 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.290101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.290545] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.290773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.290980] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63db7f7d-023b-451a-b28e-b24533d21812',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.490365] env[65427]: INFO networking_nsxv3.common.synchronization [None req-573f5687-f2a4-4134-b82f-9a606234d379 None None] Enqueued Resource ID: 6abdb033-2f64-4e67-9d81-c82159ba1b91 with Priority: HIGHEST for action port [ 594.491076] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6abdb033-2f64-4e67-9d81-c82159ba1b91 with Priority: HIGHEST for action port [ 594.491453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6abdb033-2f64-4e67-9d81-c82159ba1b91 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.491630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6abdb033-2f64-4e67-9d81-c82159ba1b91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.491753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6abdb033-2f64-4e67-9d81-c82159ba1b91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.492140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6abdb033-2f64-4e67-9d81-c82159ba1b91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.492291] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6abdb033-2f64-4e67-9d81-c82159ba1b91',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.793914] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.794939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.794939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.794939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.794939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.794939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 63db7f7d-023b-451a-b28e-b24533d21812 not found, creating... [ 594.797471] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.797471] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.797471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.797868] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 63db7f7d-023b-451a-b28e-b24533d21812 is going to be created. [ 594.825029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.825029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.825029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.825029] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.825029] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.825029] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.825029] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.825761] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.825761] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.825761] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.826994] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.826994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.827158] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.832767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.832767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.832767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.861438] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.861700] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.861940] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.862260] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.862896] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.863039] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.863577] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.864028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.864028] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a71df52-54fb-4f55-8bc7-0a8fb285d61d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.994531] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6abdb033-2f64-4e67-9d81-c82159ba1b91 [ 594.994906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.995158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.995158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.995514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.996343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.996343] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6abdb033-2f64-4e67-9d81-c82159ba1b91 already deleted. [ 594.996343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6abdb033-2f64-4e67-9d81-c82159ba1b91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.366642] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.367080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.367080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.367371] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.367523] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.367670] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 1a71df52-54fb-4f55-8bc7-0a8fb285d61d not found, creating... [ 595.367942] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.368117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.368231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.368535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.368701] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.368998] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.369175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.369293] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.369498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.369626] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.369805] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 1a71df52-54fb-4f55-8bc7-0a8fb285d61d is going to be created. [ 595.392626] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.392853] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.392974] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.393282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.393512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.393734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.589155] env[65427]: INFO networking_nsxv3.common.synchronization [None req-407edb4d-7323-46d8-8d98-3de01be80b2f None None] Enqueued Resource ID: 731e2474-8092-4cbb-ad70-bd38b7feb75f with Priority: HIGHEST for action port [ 595.589693] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 731e2474-8092-4cbb-ad70-bd38b7feb75f with Priority: HIGHEST for action port [ 595.590073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-731e2474-8092-4cbb-ad70-bd38b7feb75f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.590248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-731e2474-8092-4cbb-ad70-bd38b7feb75f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.590292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-731e2474-8092-4cbb-ad70-bd38b7feb75f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.590545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-731e2474-8092-4cbb-ad70-bd38b7feb75f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.590645] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('731e2474-8092-4cbb-ad70-bd38b7feb75f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.621423] env[65427]: INFO networking_nsxv3.common.synchronization [req-aa10e074-30df-4fcb-a444-ace7a65faa3b req-d52d0d1f-7a9a-4a80-85b2-eb09b773a43f service nova] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_rules [ 595.621786] env[65427]: INFO networking_nsxv3.common.synchronization [req-aa10e074-30df-4fcb-a444-ace7a65faa3b req-d52d0d1f-7a9a-4a80-85b2-eb09b773a43f service nova] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 595.621786] env[65427]: INFO networking_nsxv3.common.synchronization [req-aa10e074-30df-4fcb-a444-ace7a65faa3b req-d52d0d1f-7a9a-4a80-85b2-eb09b773a43f service nova] Enqueued Resource ID: 63db7f7d-023b-451a-b28e-b24533d21812 with Priority: HIGHEST for action port [ 595.622453] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_rules [ 595.622594] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 595.622704] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63db7f7d-023b-451a-b28e-b24533d21812 with Priority: HIGHEST for action port [ 595.623064] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.623196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.623259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.623504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.623585] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.624647] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.624647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.624647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.624767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.624913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.625018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.625141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.625796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.625796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.625796] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.626479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-63db7f7d-023b-451a-b28e-b24533d21812 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.626583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.626674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.626803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.626911] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63db7f7d-023b-451a-b28e-b24533d21812',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.079124] env[65427]: INFO networking_nsxv3.common.synchronization [None req-62d52dc4-cc58-4bb3-b701-addf8dd55bda None None] Enqueued Resource ID: dc96be3c-9bc9-403e-b23d-39e61eb48193 with Priority: HIGHEST for action port [ 596.079124] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc96be3c-9bc9-403e-b23d-39e61eb48193 with Priority: HIGHEST for action port [ 596.080898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc96be3c-9bc9-403e-b23d-39e61eb48193 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.081046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc96be3c-9bc9-403e-b23d-39e61eb48193" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.081661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc96be3c-9bc9-403e-b23d-39e61eb48193" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.081661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc96be3c-9bc9-403e-b23d-39e61eb48193" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.081661] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc96be3c-9bc9-403e-b23d-39e61eb48193',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.096331] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 731e2474-8092-4cbb-ad70-bd38b7feb75f [ 596.097388] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.097388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.097388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.097388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.097388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.097388] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:731e2474-8092-4cbb-ad70-bd38b7feb75f already deleted. [ 596.097388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-731e2474-8092-4cbb-ad70-bd38b7feb75f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.129728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.129965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.137195] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63db7f7d-023b-451a-b28e-b24533d21812 with status ACTIVE [ 596.137195] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.137195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.137195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.137195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.137195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.137479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.137479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.137641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.137678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.140763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.140763] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.140763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.140763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.140763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.140763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.140763] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63db7f7d-023b-451a-b28e-b24533d21812 is going to be updated. [ 596.141119] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.164701] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.164921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.165051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.165840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.166076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.166312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63db7f7d-023b-451a-b28e-b24533d21812" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [req-a52213e8-adbf-49c0-94b2-1776736d6a49 req-e94e3518-8eb5-4c27-8da0-74ec4047f2af service nova] Enqueued Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_rules [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [req-a52213e8-adbf-49c0-94b2-1776736d6a49 req-e94e3518-8eb5-4c27-8da0-74ec4047f2af service nova] Enqueued Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [req-a52213e8-adbf-49c0-94b2-1776736d6a49 req-e94e3518-8eb5-4c27-8da0-74ec4047f2af service nova] Enqueued Resource ID: 1a71df52-54fb-4f55-8bc7-0a8fb285d61d with Priority: HIGHEST for action port [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_rules [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 596.182024] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a71df52-54fb-4f55-8bc7-0a8fb285d61d with Priority: HIGHEST for action port [ 596.190248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.190248] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.190248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.190248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.190248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.190248] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.191772] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.191899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.192018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.192212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.192308] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a71df52-54fb-4f55-8bc7-0a8fb285d61d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.585055] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc96be3c-9bc9-403e-b23d-39e61eb48193 [ 596.585055] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.585413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.585413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.585485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.585580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.585654] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc96be3c-9bc9-403e-b23d-39e61eb48193 already deleted. [ 596.585735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc96be3c-9bc9-403e-b23d-39e61eb48193" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.624979] env[65427]: INFO networking_nsxv3.common.synchronization [req-d9feafee-0f67-47cc-9558-f2c1ebb8693f req-8a42815c-df96-456f-8ae9-2cc6e8431e3a tempest-FloatingIPsAssociationTestJSON-904560228 tempest-FloatingIPsAssociationTestJSON-904560228-project-member] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 596.625597] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 596.625914] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.626051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.626120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.626374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.626551] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.626657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.626744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.626897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.627051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.628373] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.644744] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.696537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.696537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.696537] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.696537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a71df52-54fb-4f55-8bc7-0a8fb285d61d with status ACTIVE [ 596.696963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.697224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.697367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.697709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.697882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.698155] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.698358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.700907] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.700907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.700907] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a71df52-54fb-4f55-8bc7-0a8fb285d61d is going to be updated. [ 596.722829] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.723439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.723517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.723736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.723879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.724063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a71df52-54fb-4f55-8bc7-0a8fb285d61d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.133099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.133302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.133349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.133761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.133985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.134498] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.134498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.134955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.135142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.135228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.135323] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc already deleted. [ 597.135776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.147230] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.147346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.147346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.147571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.147742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.147742] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be created. [ 597.178691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.178691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.178691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.178691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.178691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.188856] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: UNINITIALIZED for 2s [ 597.204556] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.348419] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.348615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.348734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.349077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.350150] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.350150] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.350150] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.350150] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.350150] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.350451] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.350451] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.350451] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.350545] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.350624] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.350734] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.350849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.369331] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.369510] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.369616] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.369779] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.370114] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.370286] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.370471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.370704] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.370838] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9cbd885-6dfe-44c2-aedc-8bf892dc46f3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.455115] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c1ca1d34-18da-42a0-8119-580d88e4d78b tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 597.455395] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 597.455697] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.455915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.455915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.456446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.456446] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.706868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.707225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.707225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.707493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.707640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.707803] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 is going to be created. [ 597.735508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.735669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.735740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.735938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.736109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.747796] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: UNINITIALIZED for 2s [ 597.873491] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.879235] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 not found, creating... [ 597.879235] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.879235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.879658] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.879658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.879658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.879658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.879658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.879658] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 is going to be created. [ 597.895531] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7da9dc54-4007-4e67-8fe6-61d8837eaa29 tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 597.895651] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 597.895892] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.896189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.903445] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.904975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.904975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.904975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.904975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.904975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.999979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.000174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.000245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.000469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.000561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.000656] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf already deleted. [ 598.000740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.000889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.001065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.001152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.319736] env[65427]: INFO networking_nsxv3.common.synchronization [req-b842dd1f-2054-44cf-afed-6691d9abfa8f req-25739afe-f206-45d1-bd3d-e3fe048eb0d0 tempest-ServerExternalEventsTest-1987515865 tempest-ServerExternalEventsTest-1987515865-project-member] Enqueued Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 598.320640] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 598.320964] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.322602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.322692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.323009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.323181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.323299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.323391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.323527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.323615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.323710] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.460122] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c26363bf-a6cb-4f56-9783-91dfc1188763 None None] Enqueued Resource ID: 5722211a-4846-4149-b18f-97d7e901c8eb with Priority: HIGHEST for action port [ 598.460633] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5722211a-4846-4149-b18f-97d7e901c8eb with Priority: HIGHEST for action port [ 598.460933] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5722211a-4846-4149-b18f-97d7e901c8eb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.461068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5722211a-4846-4149-b18f-97d7e901c8eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.461137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5722211a-4846-4149-b18f-97d7e901c8eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5722211a-4846-4149-b18f-97d7e901c8eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461467] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5722211a-4846-4149-b18f-97d7e901c8eb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.522889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.523148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.523844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.524155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.524281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.524454] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf already deleted. [ 598.524454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.600027] env[65427]: INFO networking_nsxv3.common.synchronization [req-d9feafee-0f67-47cc-9558-f2c1ebb8693f req-ede9eacb-d33d-48b4-a060-517d149a9346 service nova] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_rules [ 598.600215] env[65427]: INFO networking_nsxv3.common.synchronization [req-d9feafee-0f67-47cc-9558-f2c1ebb8693f req-ede9eacb-d33d-48b4-a060-517d149a9346 service nova] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 598.600349] env[65427]: INFO networking_nsxv3.common.synchronization [req-d9feafee-0f67-47cc-9558-f2c1ebb8693f req-ede9eacb-d33d-48b4-a060-517d149a9346 service nova] Enqueued Resource ID: e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 with Priority: HIGHEST for action port [ 598.600887] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_rules [ 598.601068] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 598.601159] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 with Priority: HIGHEST for action port [ 598.601478] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.601587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.601704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.601911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.601998] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.602923] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.603094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.603181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.603343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.603491] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.603586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.603650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.603778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.603860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.603965] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.604657] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.604751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.604816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.604973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.605063] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9cbd885-6dfe-44c2-aedc-8bf892dc46f3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.828207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.828566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.828566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.828718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.828765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.828921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.829038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.829088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.829331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.829331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.829464] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d already deleted. [ 598.829573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.964453] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5722211a-4846-4149-b18f-97d7e901c8eb [ 598.965402] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.965510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.965627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.965791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.965934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.965979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5722211a-4846-4149-b18f-97d7e901c8eb already deleted. [ 598.966101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5722211a-4846-4149-b18f-97d7e901c8eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.107032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.107032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.110024] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.110024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 with status ACTIVE [ 599.110024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.110024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.110024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.110024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.113376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.113376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.113518] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9cbd885-6dfe-44c2-aedc-8bf892dc46f3 is going to be updated. [ 599.134856] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.134856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.134856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.138558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.138558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.138558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9cbd885-6dfe-44c2-aedc-8bf892dc46f3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.200762] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: UNINITIALIZED for 4s [ 599.266289] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.266502] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.266622] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.267376] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.267670] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.267830] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.267947] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.268195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.268338] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.268542] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.268651] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.268755] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.268859] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.268963] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.269077] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.269206] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.291141] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.291359] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.291502] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.291711] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.292080] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.292256] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.292373] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.292775] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.292917] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb853fa0-f6e3-4e4d-b7f4-fda70754e70d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.615966] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.758946] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: SUCCESS [ 599.759600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.759801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.760242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.760242] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.760356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.760442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.760566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.760691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.760739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.761007] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.798065] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.798065] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.798065] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.798065] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.798065] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.798676] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port bb853fa0-f6e3-4e4d-b7f4-fda70754e70d not found, creating... [ 599.798676] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.798676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.798894] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.800825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.800825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.800825] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.800825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.800825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.801221] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.801221] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.802027] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: bb853fa0-f6e3-4e4d-b7f4-fda70754e70d is going to be created. [ 599.822574] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.822771] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.822893] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.823292] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.823537] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.824355] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.120248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.120248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.120248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.120248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.120248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.120248] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be created. [ 600.141909] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.142150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.142150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.142373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.142531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.152292] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: UNINITIALIZED for 2s [ 600.263181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.263435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.263487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.263695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.263875] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.263975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.264051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.264204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.264292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.264381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.264532] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.264623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.264683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.264820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.264955] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.265060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.265120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.265254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.265328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.265405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.265495] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.517294] env[65427]: INFO networking_nsxv3.common.synchronization [req-b842dd1f-2054-44cf-afed-6691d9abfa8f req-2115090a-d68f-44a5-9f4d-f7b5bf5ed0ad service nova] Enqueued Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_rules [ 600.517588] env[65427]: INFO networking_nsxv3.common.synchronization [req-b842dd1f-2054-44cf-afed-6691d9abfa8f req-2115090a-d68f-44a5-9f4d-f7b5bf5ed0ad service nova] Enqueued Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 600.517588] env[65427]: INFO networking_nsxv3.common.synchronization [req-b842dd1f-2054-44cf-afed-6691d9abfa8f req-2115090a-d68f-44a5-9f4d-f7b5bf5ed0ad service nova] Enqueued Resource ID: bb853fa0-f6e3-4e4d-b7f4-fda70754e70d with Priority: HIGHEST for action port [ 600.518107] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_rules [ 600.518242] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 600.518342] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb853fa0-f6e3-4e4d-b7f4-fda70754e70d with Priority: HIGHEST for action port [ 600.518678] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.518779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.518779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.519166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.519270] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.520180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.520180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.520393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.520428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.520742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.520742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.520742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.521094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.521167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.521268] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.522810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.523805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.523890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.525149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.525235] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb853fa0-f6e3-4e4d-b7f4-fda70754e70d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.754071] env[65427]: INFO networking_nsxv3.common.synchronization [req-ba6aa059-1040-48e8-a0a8-9bc18ef0a325 req-6deaf3ac-0c36-4654-a8d2-a638f5aeaa1f tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 600.754645] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 600.754980] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.755110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.755233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.755471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.755693] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.755777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.755848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.756130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.756230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.756329] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.767690] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfc5b74e-b81a-42f3-a700-31dc0eae6488: rpc.has_security_group_logging(os_id): False [ 600.788030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.788030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.788030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.788030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.788030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.788321] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.788321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.788321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.788442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.788471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.789026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.789026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.789026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.789026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.789026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.789277] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.789277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.789376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.789467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.789540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.789625] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 is going to be created. [ 600.853896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.854519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.854810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.855052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.855484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.870034] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: IN_PROGRESS for 2s [ 601.030383] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb853fa0-f6e3-4e4d-b7f4-fda70754e70d with status ACTIVE [ 601.030912] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.030912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.030912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.031086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.031170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.031723] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.031723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.031723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.031723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.031891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.032065] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.032126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.032181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.032343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.032419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.032544] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb853fa0-f6e3-4e4d-b7f4-fda70754e70d is going to be updated. [ 601.034246] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.035266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.035975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.067471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.067471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.067471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.067471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.067471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.067471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb853fa0-f6e3-4e4d-b7f4-fda70754e70d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.212280] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 601.212895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.212895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.212895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.213170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.213299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.213364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.213530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.213612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.213698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.213791] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.260495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.260686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.260757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.260931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.261031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.261260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.262196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.262196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.262196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.262196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.262196] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad already deleted. [ 601.262196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.323050] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f5f3df1c-a984-4a48-8b65-2bc8c05491e3 None None] Enqueued Resource ID: 37955bf5-7bd3-43a3-a375-f0e1c067b63b with Priority: HIGHEST for action port [ 601.323927] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37955bf5-7bd3-43a3-a375-f0e1c067b63b with Priority: HIGHEST for action port [ 601.324496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-37955bf5-7bd3-43a3-a375-f0e1c067b63b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.325028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37955bf5-7bd3-43a3-a375-f0e1c067b63b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.325028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37955bf5-7bd3-43a3-a375-f0e1c067b63b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.325724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37955bf5-7bd3-43a3-a375-f0e1c067b63b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.325724] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37955bf5-7bd3-43a3-a375-f0e1c067b63b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.536350] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.716622] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.716809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.716881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.717145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.717326] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.719014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.719194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.719293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.719387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.719479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.719650] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.719748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.719809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.719960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.720117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.720211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.720272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.720408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.720485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.720563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.720654] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.778511] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.778728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.778849] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.779328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.779489] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.779646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.779768] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.780011] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.780279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.780382] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.780491] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.780613] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.780726] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.780830] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.780929] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.781085] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.808062] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.808207] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.808351] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.808510] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.808871] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-b9d0d97c-b407-4b73-8bcc-f035571223b2 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.809080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.809193] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.809524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.809662] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d0d97c-b407-4b73-8bcc-f035571223b2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.827185] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37955bf5-7bd3-43a3-a375-f0e1c067b63b [ 601.827429] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.827564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.827634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.828205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.828205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.828205] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37955bf5-7bd3-43a3-a375-f0e1c067b63b already deleted. [ 601.828205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37955bf5-7bd3-43a3-a375-f0e1c067b63b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.022021] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b6e9cfbc-d8ed-4f7c-98db-63cbb735fc60 None None] Enqueued Resource ID: aaa522c2-74fe-4346-a385-c598627ace8f with Priority: HIGHEST for action port [ 602.022021] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa522c2-74fe-4346-a385-c598627ace8f with Priority: HIGHEST for action port [ 602.025523] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa522c2-74fe-4346-a385-c598627ace8f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.025523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa522c2-74fe-4346-a385-c598627ace8f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.025523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa522c2-74fe-4346-a385-c598627ace8f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.025665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa522c2-74fe-4346-a385-c598627ace8f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.025701] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa522c2-74fe-4346-a385-c598627ace8f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.039670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.039833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.040019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.040986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.040986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.040986] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d is going to be created. [ 602.070850] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.070850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.070850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.070850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.070850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.082579] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: UNINITIALIZED for 2s [ 602.161346] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 602.161790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.162137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.162522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.162843] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.163138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.163308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.163566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.163752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.164013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.164232] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.224835] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d911c02-2fb8-4b8a-94ab-e744e4a812ee: rpc.has_security_group_logging(os_id): False [ 602.247110] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.247290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.247365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.247577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.247657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.247846] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.247942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.248017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.248168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.248245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.248440] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.248534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.248596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.248734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.248807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.249025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.249118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.249182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.249318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.249392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.249476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be created. [ 602.313823] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.313823] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314097] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314257] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.314419] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.314716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port b9d0d97c-b407-4b73-8bcc-f035571223b2 not found, creating... [ 602.314848] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315023] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.315141] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.315364] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.315474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315791] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315944] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.316067] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316269] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.316528] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: b9d0d97c-b407-4b73-8bcc-f035571223b2 is going to be created. [ 602.344614] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.344807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.344847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.345101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.345288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.349523] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.349898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.349898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.350136] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.350425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.350564] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.359250] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 602.529306] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaa522c2-74fe-4346-a385-c598627ace8f [ 602.529306] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.529306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.529306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.529564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.529564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.529564] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaa522c2-74fe-4346-a385-c598627ace8f already deleted. [ 602.529659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa522c2-74fe-4346-a385-c598627ace8f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.667699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.667854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.667934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.668153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.668613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.668613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.668613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.668613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.669116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.669116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.669116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.669116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.669116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.669357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.669357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.669469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.669469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.669865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.669865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.669865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.669865] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.883050] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: SUCCESS [ 602.883050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.062497] env[65427]: INFO networking_nsxv3.common.synchronization [req-ba6aa059-1040-48e8-a0a8-9bc18ef0a325 req-b5460e38-e3bf-4dc7-96aa-edcf416a723c service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 603.062497] env[65427]: INFO networking_nsxv3.common.synchronization [req-ba6aa059-1040-48e8-a0a8-9bc18ef0a325 req-b5460e38-e3bf-4dc7-96aa-edcf416a723c service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 603.062497] env[65427]: INFO networking_nsxv3.common.synchronization [req-ba6aa059-1040-48e8-a0a8-9bc18ef0a325 req-b5460e38-e3bf-4dc7-96aa-edcf416a723c service nova] Enqueued Resource ID: b9d0d97c-b407-4b73-8bcc-f035571223b2 with Priority: HIGHEST for action port [ 603.062901] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 603.062901] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 603.062901] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d0d97c-b407-4b73-8bcc-f035571223b2 with Priority: HIGHEST for action port [ 603.063224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.063302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.063338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.063565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.063644] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.064561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.064663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.064737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.064933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.065110] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.065200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.065260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.065461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.065542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.065578] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.066797] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9d0d97c-b407-4b73-8bcc-f035571223b2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.066882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.066947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.067119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.067191] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9d0d97c-b407-4b73-8bcc-f035571223b2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.069854] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a3bc650e-352c-41a5-9286-52207be73a02 None None] Enqueued Resource ID: bb54feec-1f82-4891-9bbb-dd7297f51656 with Priority: HIGHEST for action port [ 603.071629] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb54feec-1f82-4891-9bbb-dd7297f51656 with Priority: HIGHEST for action port [ 603.072189] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb54feec-1f82-4891-9bbb-dd7297f51656 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.072327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb54feec-1f82-4891-9bbb-dd7297f51656" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.072382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb54feec-1f82-4891-9bbb-dd7297f51656" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.072565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb54feec-1f82-4891-9bbb-dd7297f51656" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.072640] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb54feec-1f82-4891-9bbb-dd7297f51656',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.174509] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e055f6e8-5bdf-4d73-ac15-366894643fcc: rpc.has_security_group_logging(os_id): False [ 603.194625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.194873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.194873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.195185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.195185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.195346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.195449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.195503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.195633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.195698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.195896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.196011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.196075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.196195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.196260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.198236] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.198236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.198236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.198236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.198236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.198236] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be created. [ 603.275235] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.275669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.275669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.276704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.276908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.301268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 603.408448] env[65427]: INFO networking_nsxv3.common.synchronization [req-33a6871e-d726-40c7-959e-c45c5a2de934 req-fea080b2-ef3f-432f-9caf-a11267e2ecd6 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 603.408937] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 603.409257] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.409383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.409452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.409701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.409883] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.409990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.410147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.410319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.410464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.410563] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.570783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.571076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.571309] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.572289] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9d0d97c-b407-4b73-8bcc-f035571223b2 with status ACTIVE [ 603.572595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.572746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.572839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.573105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.573356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.573751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.573751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.573875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.574063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.574650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.574650] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.574650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.574650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.575765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.575831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.575999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9d0d97c-b407-4b73-8bcc-f035571223b2 is going to be updated. [ 603.578078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb54feec-1f82-4891-9bbb-dd7297f51656 [ 603.578078] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.578078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.578078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.578078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.578078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.578078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb54feec-1f82-4891-9bbb-dd7297f51656 already deleted. [ 603.578078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb54feec-1f82-4891-9bbb-dd7297f51656" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.599821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.599821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.599821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.599821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.599821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.599821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9d0d97c-b407-4b73-8bcc-f035571223b2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.862659] env[65427]: INFO networking_nsxv3.common.synchronization [None req-bd14fe90-905b-46ed-9564-5d35bd2eb6f1 None None] Enqueued Resource ID: 8adfbf9c-2262-4a28-a1fb-9e2419c3c37d with Priority: HIGHEST for action port [ 603.863268] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adfbf9c-2262-4a28-a1fb-9e2419c3c37d with Priority: HIGHEST for action port [ 603.863590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8adfbf9c-2262-4a28-a1fb-9e2419c3c37d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.863714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8adfbf9c-2262-4a28-a1fb-9e2419c3c37d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.863782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8adfbf9c-2262-4a28-a1fb-9e2419c3c37d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.866179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8adfbf9c-2262-4a28-a1fb-9e2419c3c37d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.866772] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8adfbf9c-2262-4a28-a1fb-9e2419c3c37d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.913913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.913913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.914880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.915832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.915832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.915832] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.916138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.916138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.916260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.916359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.916506] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 already deleted. [ 603.916506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.014408] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014631] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.014733] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.015513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.015868] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.016058] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.016183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016595] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.016846] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.017225] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.017326] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.017441] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.017546] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.017677] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.017792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.043686] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.043872] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.043970] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.044163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.044497] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.044669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.044785] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.045160] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.045304] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e750c8b-50eb-417a-b810-00f4f8a7ef2e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.078027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.094108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: SUCCESS [ 604.094386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.094817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.095062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.095262] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.095520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.095595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.095765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.095849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.095938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.096045] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.368277] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8adfbf9c-2262-4a28-a1fb-9e2419c3c37d [ 604.368648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.368792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.369138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.369472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.369646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.370236] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8adfbf9c-2262-4a28-a1fb-9e2419c3c37d already deleted. [ 604.370381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8adfbf9c-2262-4a28-a1fb-9e2419c3c37d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.374723] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 604.374996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.549485] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.549752] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.549875] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.550150] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.550304] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.550484] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 9e750c8b-50eb-417a-b810-00f4f8a7ef2e not found, creating... [ 604.550746] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.550892] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.550970] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.551210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.551347] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.551627] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.551781] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.551893] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.554275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.554275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.554275] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 9e750c8b-50eb-417a-b810-00f4f8a7ef2e is going to be created. [ 604.579041] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.579401] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.579455] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.579698] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.579927] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583044] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.583044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.583044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.583044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.583044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583044] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be created. [ 604.597820] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.597983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.598070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.598321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.598550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.598670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.598766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.598934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.599035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.599128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.599284] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.599379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.599434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.599574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.599714] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.599804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.599865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.600081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.600168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.600255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.600345] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.616233] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.616424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.616424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.616649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.616807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.631162] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: UNINITIALIZED for 2s [ 604.838647] env[65427]: INFO networking_nsxv3.common.synchronization [None req-34f232fe-489c-4f60-9b28-5c9a682c8158 None None] Enqueued Resource ID: 8a1e7277-1ae0-4670-b62e-1e6c83958508 with Priority: HIGHEST for action port [ 604.839251] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1e7277-1ae0-4670-b62e-1e6c83958508 with Priority: HIGHEST for action port [ 604.839667] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a1e7277-1ae0-4670-b62e-1e6c83958508 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.839799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a1e7277-1ae0-4670-b62e-1e6c83958508" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.840067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a1e7277-1ae0-4670-b62e-1e6c83958508" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.840358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a1e7277-1ae0-4670-b62e-1e6c83958508" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.840459] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1e7277-1ae0-4670-b62e-1e6c83958508',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.102861] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 529af775-9e29-4633-b5c4-0f3bcc0e524d: rpc.has_security_group_logging(os_id): False [ 605.121488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.121644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.121717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.121983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.122122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.122359] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.122466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.122531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.126541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.126699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.126968] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.127355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.127427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.127636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.127847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.129926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.130056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.130131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.130302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.130382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.131113] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d is going to be created. [ 605.187491] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.187656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.187730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.188247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.188247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.199159] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: IN_PROGRESS for 2s [ 605.317305] env[65427]: INFO networking_nsxv3.common.synchronization [req-33a6871e-d726-40c7-959e-c45c5a2de934 req-0e634670-e26b-4e63-a11f-377b135518ab service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 605.317305] env[65427]: INFO networking_nsxv3.common.synchronization [req-33a6871e-d726-40c7-959e-c45c5a2de934 req-0e634670-e26b-4e63-a11f-377b135518ab service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 605.317305] env[65427]: INFO networking_nsxv3.common.synchronization [req-33a6871e-d726-40c7-959e-c45c5a2de934 req-0e634670-e26b-4e63-a11f-377b135518ab service nova] Enqueued Resource ID: 9e750c8b-50eb-417a-b810-00f4f8a7ef2e with Priority: HIGHEST for action port [ 605.317849] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 605.317993] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 605.319329] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e750c8b-50eb-417a-b810-00f4f8a7ef2e with Priority: HIGHEST for action port [ 605.319548] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.319731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.319826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.320183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.320301] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.321742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.321742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.321742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.325020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.325020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.325020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.325020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.325020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e750c8b-50eb-417a-b810-00f4f8a7ef2e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.327214] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 605.330040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.343118] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a1e7277-1ae0-4670-b62e-1e6c83958508 [ 605.343397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.343490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.343529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.344265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.344265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.344265] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a1e7277-1ae0-4670-b62e-1e6c83958508 already deleted. [ 605.344265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a1e7277-1ae0-4670-b62e-1e6c83958508" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.832041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.832041] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.832041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e750c8b-50eb-417a-b810-00f4f8a7ef2e with status ACTIVE [ 605.832041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.832041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.832041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.832941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.832941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.832941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.832941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.832941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.832941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.832941] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e750c8b-50eb-417a-b810-00f4f8a7ef2e is going to be updated. [ 605.858796] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.858942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.859025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.859277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.859447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.859828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e750c8b-50eb-417a-b810-00f4f8a7ef2e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.226699] env[65427]: INFO networking_nsxv3.common.synchronization [req-05bf7421-9ab2-4a76-9e1d-1b1d88e299fa req-e9260348-64fa-4919-982e-11b71db11444 tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: 148f60cb-9202-4d66-ad0a-f39b94cc561c with Priority: HIGHEST for action security_group_rules [ 606.227777] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 148f60cb-9202-4d66-ad0a-f39b94cc561c with Priority: HIGHEST for action security_group_rules [ 606.228691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-148f60cb-9202-4d66-ad0a-f39b94cc561c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.228691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-148f60cb-9202-4d66-ad0a-f39b94cc561c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.228691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-148f60cb-9202-4d66-ad0a-f39b94cc561c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.231493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-148f60cb-9202-4d66-ad0a-f39b94cc561c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.231493] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('148f60cb-9202-4d66-ad0a-f39b94cc561c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.337326] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.644198] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 606.644479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.644819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.646024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.646363] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.646529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.646601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.646796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.646881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.646975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647732] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.766279] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.766494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.766575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.766865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.766977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.767118] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 148f60cb-9202-4d66-ad0a-f39b94cc561c already deleted. [ 606.767211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-148f60cb-9202-4d66-ad0a-f39b94cc561c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.843511] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4f77e373-88c1-499a-9ad6-e906c8d31e09 None None] Enqueued Resource ID: 4ab34d76-c4ac-4ebf-9422-710f6a02b7ce with Priority: HIGHEST for action port [ 606.843511] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.843511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.845067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.849596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.849596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.849596] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be created. [ 606.849596] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ab34d76-c4ac-4ebf-9422-710f6a02b7ce with Priority: HIGHEST for action port [ 606.849596] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ab34d76-c4ac-4ebf-9422-710f6a02b7ce taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.849596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ab34d76-c4ac-4ebf-9422-710f6a02b7ce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.849596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ab34d76-c4ac-4ebf-9422-710f6a02b7ce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.849596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ab34d76-c4ac-4ebf-9422-710f6a02b7ce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.849596] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ab34d76-c4ac-4ebf-9422-710f6a02b7ce',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.880102] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.882083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.882083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.882083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.882083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.896757] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: UNINITIALIZED for 2s [ 607.152885] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.153273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.153411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.153667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.153882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.154082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.154144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.154536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.154536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.154674] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.154674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.154770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.155034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.155107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.155169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.155305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.155379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.155460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.155548] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.212944] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: SUCCESS [ 607.212944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.275729] env[65427]: INFO networking_nsxv3.common.synchronization [req-2d7f3d6d-17ac-4db0-9f72-02719f33581b req-fc906893-5592-4de9-999f-03cc29827c07 tempest-ServerDiagnosticsTest-18153023 tempest-ServerDiagnosticsTest-18153023-project-member] Enqueued Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 607.276306] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 607.276619] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.276741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.276809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.278675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.278675] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.278675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.278675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.278675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.278675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.278675] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.356368] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ab34d76-c4ac-4ebf-9422-710f6a02b7ce [ 607.357036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.357036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.357255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.357369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.357475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.357554] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ab34d76-c4ac-4ebf-9422-710f6a02b7ce already deleted. [ 607.357639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ab34d76-c4ac-4ebf-9422-710f6a02b7ce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.626356] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.626356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.626356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.626356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.626356] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.626356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.626669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.626669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.627040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.627040] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.627040] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.627147] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.627251] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.627370] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.627473] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.627603] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.653606] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.653606] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.653606] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.653606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.653606] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-c125ecc8-3750-4854-8e07-867bfb810754 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.653606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.653606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.653606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.653606] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c125ecc8-3750-4854-8e07-867bfb810754',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.659232] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54fe1b7a-483b-4522-ab83-ced21005a9ad: rpc.has_security_group_logging(os_id): False [ 607.680505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.680505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.680505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.680505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.681067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.681067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.681067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.681172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.681358] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.683884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.683884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.683884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.683884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.683884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be created. [ 607.759784] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.760131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.760131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.760282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.760513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.778183] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 607.782890] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.782890] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.782890] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd already deleted. [ 607.782890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.157041] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.157546] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.157546] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.159346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.159596] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.159800] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port c125ecc8-3750-4854-8e07-867bfb810754 not found, creating... [ 608.160199] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.160402] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.160553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.160821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.161013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.161343] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.161567] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.161732] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.162077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.162404] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.162698] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: c125ecc8-3750-4854-8e07-867bfb810754 is going to be created. [ 608.185605] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.185907] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.186195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.187204] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.187473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.187722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.907917] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 608.907917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.908074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.908886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.909117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.909243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.909307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.909658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.909894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.909984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.910095] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.938553] env[65427]: INFO networking_nsxv3.common.synchronization [req-2d7f3d6d-17ac-4db0-9f72-02719f33581b req-4e06a170-05e6-4c5a-a0fb-5bdaba1931a7 service nova] Enqueued Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_rules [ 608.938553] env[65427]: INFO networking_nsxv3.common.synchronization [req-2d7f3d6d-17ac-4db0-9f72-02719f33581b req-4e06a170-05e6-4c5a-a0fb-5bdaba1931a7 service nova] Enqueued Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 608.938553] env[65427]: INFO networking_nsxv3.common.synchronization [req-2d7f3d6d-17ac-4db0-9f72-02719f33581b req-4e06a170-05e6-4c5a-a0fb-5bdaba1931a7 service nova] Enqueued Resource ID: c125ecc8-3750-4854-8e07-867bfb810754 with Priority: HIGHEST for action port [ 608.940320] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_rules [ 608.940320] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 608.940458] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c125ecc8-3750-4854-8e07-867bfb810754 with Priority: HIGHEST for action port [ 608.941460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.941460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.941460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.941460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.941460] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.943897] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.943897] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.943897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.943897] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.944553] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c125ecc8-3750-4854-8e07-867bfb810754 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.944694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.944765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.944890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.944960] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c125ecc8-3750-4854-8e07-867bfb810754',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.313227] env[65427]: INFO networking_nsxv3.common.synchronization [req-be403516-55cf-44c5-ae77-1ee43a03a7f2 req-f5d89d0b-afd8-4316-b2e4-bbadf644cb89 tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 609.313757] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 609.314088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.314218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.314286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.314541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.314706] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.314809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.314872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.315060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.315153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.315248] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.413129] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.413129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.413271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.414073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.414073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.414073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.414073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.414073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.414073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.414561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.414561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.414561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.414674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.414775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.414927] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.415033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.415096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.415458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.415543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.416178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.416339] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.447265] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c125ecc8-3750-4854-8e07-867bfb810754 with status ACTIVE [ 609.448025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.448025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.448025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.448025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.448025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.448279] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.448279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.448279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.448415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.448492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.448671] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.448822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.448822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.448948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.449034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.449374] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c125ecc8-3750-4854-8e07-867bfb810754 is going to be updated. [ 609.450260] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.451102] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.451215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.473073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.473073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.473320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.473670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.473670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.474202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c125ecc8-3750-4854-8e07-867bfb810754" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.646921] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.647153] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.647271] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.647585] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.647848] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.647994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.648907] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.649167] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.649658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.649658] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.649658] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.649911] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.649911] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.649979] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.650050] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.650181] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.673892] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.674070] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.674210] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.675196] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.675196] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-e0b6f181-7145-42d3-a3a4-26d84d793ca5 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.675196] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.675196] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.675642] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.675642] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b6f181-7145-42d3-a3a4-26d84d793ca5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.797182] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 609.797182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.817636] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.817636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.817900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.818090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.818150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.818571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.818571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.818571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.818752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.818834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.818951] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f already deleted. [ 609.819094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.921097] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7abbe624-4b85-4277-bdd0-ed749e166fc9: rpc.has_security_group_logging(os_id): False [ 609.938796] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.940594] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.940594] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.941089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.941089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.941992] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.941992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.941992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.941992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.942267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.942267] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be created. [ 609.953499] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.003200] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.003342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.003342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.003572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.004320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.017053] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 610.178872] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.179210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.179387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.179673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.179824] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.179979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port e0b6f181-7145-42d3-a3a4-26d84d793ca5 not found, creating... [ 610.183032] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.183032] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.183032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.183636] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: e0b6f181-7145-42d3-a3a4-26d84d793ca5 is going to be created. [ 610.209978] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.209978] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.210179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.210402] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.211025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.211109] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.457257] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.457578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.457578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.457732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.457823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.457922] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd is going to be created. [ 610.484061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.484187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.484255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.484690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.485531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.500830] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: UNINITIALIZED for 2s [ 610.925627] env[65427]: INFO networking_nsxv3.common.synchronization [req-be403516-55cf-44c5-ae77-1ee43a03a7f2 req-e1d8b634-4ed0-4164-becb-ad12870f3730 service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 610.925989] env[65427]: INFO networking_nsxv3.common.synchronization [req-be403516-55cf-44c5-ae77-1ee43a03a7f2 req-e1d8b634-4ed0-4164-becb-ad12870f3730 service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 610.926327] env[65427]: INFO networking_nsxv3.common.synchronization [req-be403516-55cf-44c5-ae77-1ee43a03a7f2 req-e1d8b634-4ed0-4164-becb-ad12870f3730 service nova] Enqueued Resource ID: e0b6f181-7145-42d3-a3a4-26d84d793ca5 with Priority: HIGHEST for action port [ 610.927065] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 610.928370] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 610.928546] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0b6f181-7145-42d3-a3a4-26d84d793ca5 with Priority: HIGHEST for action port [ 610.929071] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.929253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.929253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.932173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.932173] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.932173] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.932173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.932173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.932173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.932173] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.932173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.932603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.932603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.932603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.932713] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.934039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0b6f181-7145-42d3-a3a4-26d84d793ca5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.934039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.934039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.934039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.934039] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b6f181-7145-42d3-a3a4-26d84d793ca5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.436954] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.436954] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.436954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.437479] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0b6f181-7145-42d3-a3a4-26d84d793ca5 with status ACTIVE [ 611.437479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.437570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.438506] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.438506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.438794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.438794] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.438794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.438922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.438976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.440028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.440565] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0b6f181-7145-42d3-a3a4-26d84d793ca5 is going to be updated. [ 611.464931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.465364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.465364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.465918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.466125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.466343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0b6f181-7145-42d3-a3a4-26d84d793ca5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.938811] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.031077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 612.031377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.087917] env[65427]: INFO networking_nsxv3.common.synchronization [req-3a85c79a-854e-4089-916b-36aeae84114c req-ea397ebe-60eb-4352-b8c6-ac2eff0393a7 tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: 5860b85e-2b69-4062-99b7-e78367a5b216 with Priority: HIGHEST for action security_group_rules [ 612.088498] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5860b85e-2b69-4062-99b7-e78367a5b216 with Priority: HIGHEST for action security_group_rules [ 612.088817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5860b85e-2b69-4062-99b7-e78367a5b216 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.088989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5860b85e-2b69-4062-99b7-e78367a5b216" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.090685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5860b85e-2b69-4062-99b7-e78367a5b216" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.091866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5860b85e-2b69-4062-99b7-e78367a5b216" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.092056] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5860b85e-2b69-4062-99b7-e78367a5b216',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.440691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.440889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.440930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.441165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.441299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.441475] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be created. [ 612.469749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.470239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.470576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.470790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.471280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.481227] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: UNINITIALIZED for 2s [ 612.510188] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: SUCCESS [ 612.510430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.510588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.511564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.511767] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.511889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.511958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.512152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.512243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.512331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.512423] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.617702] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.617702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.617702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.617702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.617702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.617702] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5860b85e-2b69-4062-99b7-e78367a5b216 already deleted. [ 612.617702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5860b85e-2b69-4062-99b7-e78367a5b216" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.017713] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.018035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.018153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.018412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.018624] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.018694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.018797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.018923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.018997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.019749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.019749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.019749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.019749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.019749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.020108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.021741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.021826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.022014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.022282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.022354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.022436] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.525410] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e08d6a87-c5be-4f46-9078-9a60601143bd: rpc.has_security_group_logging(os_id): False [ 613.544070] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.544330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.544330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.544554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.544644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.544800] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.544900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.545037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.545145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.545213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.545455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.545567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.545567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.545705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.545753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.547369] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.547524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.547613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.547845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.547942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.548504] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd is going to be created. [ 613.620022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.620233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.620288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.620474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.620682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.633899] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: IN_PROGRESS for 2s [ 614.495213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 614.495499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.495701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.495916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.496165] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.496307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.496396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.496696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.496802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.496921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.497054] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.771851] env[65427]: INFO networking_nsxv3.common.synchronization [req-a2d7b05f-ed71-47b6-9cff-5cbf0cbe3546 req-0a6d73ae-0216-48c8-85c0-53312336ed19 tempest-VolumesAssistedSnapshotsTest-2048674847 tempest-VolumesAssistedSnapshotsTest-2048674847-project-member] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 614.772439] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 614.772913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.773154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.773320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.773680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.774015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.774251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.774389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.774675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.774891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.775097] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.002247] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.002458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.002541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.002764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.002973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.003101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.003184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.003345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.003434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.003642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.003732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.003779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.003809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.003948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.004098] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.004193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.004252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.004397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.004483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.004553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.004639] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.044859] env[65427]: INFO networking_nsxv3.common.synchronization [req-22f3f201-e112-4e51-9350-1073d8fc23ae req-11340741-6edf-4b41-81f7-91ba3bce2907 tempest-DeleteServersAdminTestJSON-1881041213 tempest-DeleteServersAdminTestJSON-1881041213-project-admin] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 615.045593] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 615.045930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.046070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.046136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.046336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.046491] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.046593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.046648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.046790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.046863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.046959] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.279528] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.279528] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.279528] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008bf551-bcd7-451b-8250-579db77bad7d already deleted. [ 615.279528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.506957] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc0cbb36-d62c-40ce-9e79-61f04e36627f: rpc.has_security_group_logging(os_id): False [ 615.527650] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.527650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.527650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.527650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.527650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.528064] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.528064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.528174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.528281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.528364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.528571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.528668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.528731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.528875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.528953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.529320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.529467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.529560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.529736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.529844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.529963] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be created. [ 615.552289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.552289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.552289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.552289] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be updated. [ 615.584400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.584942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.584942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.586671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.588021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.599071] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 615.607478] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.607478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.607478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.607478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.607478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.618770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 615.647781] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: SUCCESS [ 615.647983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.714023] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-377 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.714023] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-377" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.714023] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-377" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.714023] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-377" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.714586] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.714931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.715208] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.715572] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.715835] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.716174] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.716417] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.716660] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.717604] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.717604] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.717604] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.717604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.752906] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.753242] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.753476] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.753685] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-377" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.754056] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-b43f4680-7e82-4311-88ef-ad51c456b161 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.754288] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.754400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.754813] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.754955] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43f4680-7e82-4311-88ef-ad51c456b161',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.257683] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.258396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.258673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.259580] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.259944] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.260242] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port b43f4680-7e82-4311-88ef-ad51c456b161 not found, creating... [ 616.260745] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.261186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.261526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.263652] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.263652] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.263652] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.263652] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.263652] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.263652] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.263981] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.263981] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: b43f4680-7e82-4311-88ef-ad51c456b161 is going to be created. [ 616.298182] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.298401] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.298467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.298885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.299143] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.299377] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.612333] env[65427]: INFO networking_nsxv3.common.synchronization [req-4fca1527-2fc7-4157-9fa4-ff9dd88b64ce req-97124969-0326-4ca4-a2a3-87dc94e438ac tempest-ServerDiagnosticsNegativeTest-1656538749 tempest-ServerDiagnosticsNegativeTest-1656538749-project-member] Enqueued Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 616.613255] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGHEST for action security_group_members [ 616.613659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.613827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.613928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.614222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.614449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.614592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.614688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.614895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.615031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.615169] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.989030] env[65427]: INFO networking_nsxv3.common.synchronization [None req-23e2dcbd-b847-405f-89a5-c0283c85f72b None None] Enqueued Resource ID: a05e3762-bb69-4b1a-bf44-99695edee407 with Priority: HIGHEST for action port [ 616.989626] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a05e3762-bb69-4b1a-bf44-99695edee407 with Priority: HIGHEST for action port [ 616.990610] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a05e3762-bb69-4b1a-bf44-99695edee407 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.990610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a05e3762-bb69-4b1a-bf44-99695edee407" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.990894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a05e3762-bb69-4b1a-bf44-99695edee407" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.991032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a05e3762-bb69-4b1a-bf44-99695edee407" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.991101] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a05e3762-bb69-4b1a-bf44-99695edee407',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [req-a2d7b05f-ed71-47b6-9cff-5cbf0cbe3546 req-2e1d31e1-87a6-4bbb-9315-ab02ae9bb99b service nova] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [req-a2d7b05f-ed71-47b6-9cff-5cbf0cbe3546 req-2e1d31e1-87a6-4bbb-9315-ab02ae9bb99b service nova] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [req-a2d7b05f-ed71-47b6-9cff-5cbf0cbe3546 req-2e1d31e1-87a6-4bbb-9315-ab02ae9bb99b service nova] Enqueued Resource ID: b43f4680-7e82-4311-88ef-ad51c456b161 with Priority: HIGHEST for action port [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_rules [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 617.063393] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43f4680-7e82-4311-88ef-ad51c456b161 with Priority: HIGHEST for action port [ 617.063393] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.063393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.063393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.063393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.064105] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.064982] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.065119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.065238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.065367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.065765] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.065859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.065927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.066104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.066192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.066289] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.067988] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b43f4680-7e82-4311-88ef-ad51c456b161 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.068117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.068182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.068349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.068428] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43f4680-7e82-4311-88ef-ad51c456b161',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.117745] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.117936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.117994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.122296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.122414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.122642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.122760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.122842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.123014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.123097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.123190] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 is going to be updated. [ 617.157874] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.158075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.158964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.158964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.167397] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: IN_PROGRESS for 2s [ 617.494509] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a05e3762-bb69-4b1a-bf44-99695edee407 [ 617.494915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.495035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.495114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.495343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.495465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.495527] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a05e3762-bb69-4b1a-bf44-99695edee407 already deleted. [ 617.495652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a05e3762-bb69-4b1a-bf44-99695edee407" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.569079] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.570989] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.571115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.571559] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b43f4680-7e82-4311-88ef-ad51c456b161 with status ACTIVE [ 617.572291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.572291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.572291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.572291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.572291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.572856] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.572856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.572856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.573579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.573781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.574299] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.575342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.575342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.575342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.575342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.575342] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b43f4680-7e82-4311-88ef-ad51c456b161 is going to be updated. [ 617.600543] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.600766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.600766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.600979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.601171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.601308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b43f4680-7e82-4311-88ef-ad51c456b161" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.615057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 617.615262] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee deletion is rescheduled due to dependency. [ 617.615262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.632536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 617.632536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.078090] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.130225] env[65427]: INFO networking_nsxv3.common.synchronization [req-e0780e81-7202-4b7c-b0a2-d8db5c2d76cc req-4dde07ca-540a-4865-b80e-f6dda849e6e7 tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 618.130791] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 618.131108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.131255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.131307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.131582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.131757] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.131918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.132016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.132204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.132265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.132366] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.584516] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.584516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.584516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.584516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.584516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.584516] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008bf551-bcd7-451b-8250-579db77bad7d is going to be created. [ 618.613533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.613834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.613834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.613964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.614179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.629306] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: UNINITIALIZED for 2s [ 618.634868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.635035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.635103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.635380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.635482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.635677] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.635782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.635849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.636028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.636109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.636195] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 already deleted. [ 618.636279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.849090] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.849605] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.849605] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.849815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.850313] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.850313] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.850537] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.850612] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.850706] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.850904] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.851045] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.851127] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.851229] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.851334] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.851435] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.851561] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.872346] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.872580] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.872735] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.872913] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.873287] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-7eecdc42-c890-467c-9c15-bbe0a2016860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.873404] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.873519] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.873847] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.873977] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecdc42-c890-467c-9c15-bbe0a2016860',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.177581] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 in Status: SUCCESS [ 619.177769] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 deletion is rescheduled due to dependency. [ 619.177896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.325442] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ad390262-459e-4c70-857f-78631ac42644 None None] Enqueued Resource ID: 65bc1c18-293e-46cf-8587-a9a06764761c with Priority: HIGHEST for action port [ 619.325442] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bc1c18-293e-46cf-8587-a9a06764761c with Priority: HIGHEST for action port [ 619.325442] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-65bc1c18-293e-46cf-8587-a9a06764761c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.325442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65bc1c18-293e-46cf-8587-a9a06764761c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.325442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65bc1c18-293e-46cf-8587-a9a06764761c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.325723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65bc1c18-293e-46cf-8587-a9a06764761c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.325723] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65bc1c18-293e-46cf-8587-a9a06764761c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.377140] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.377347] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.377447] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.377726] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.377871] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.378028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 7eecdc42-c890-467c-9c15-bbe0a2016860 not found, creating... [ 619.378633] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.378633] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.378633] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.378856] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.378950] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.379488] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.379488] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.379757] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.379757] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.379844] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.379960] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 7eecdc42-c890-467c-9c15-bbe0a2016860 is going to be created. [ 619.402121] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.402366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.402433] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.402703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.402943] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.403213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.544950] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b208d7-56a1-4a63-98e0-9c380805ae5f req-0fcbab25-37df-49af-a993-832dfd25759b tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 619.544950] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 619.544950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.544950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.544950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.545326] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.545394] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.545466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.545520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.545664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.546020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.546020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.830298] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65bc1c18-293e-46cf-8587-a9a06764761c [ 619.830581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.830675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.830746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.830964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.831073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.831159] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65bc1c18-293e-46cf-8587-a9a06764761c already deleted. [ 619.831241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65bc1c18-293e-46cf-8587-a9a06764761c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.048152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.048873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.048873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.048873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.048873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.049286] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.049286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.049286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.049286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.049694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.049694] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf already deleted. [ 620.049694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.199536] env[65427]: INFO networking_nsxv3.common.synchronization [req-e0780e81-7202-4b7c-b0a2-d8db5c2d76cc req-97319312-e27a-4a3d-8218-8e4699e52e38 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 620.199802] env[65427]: INFO networking_nsxv3.common.synchronization [req-e0780e81-7202-4b7c-b0a2-d8db5c2d76cc req-97319312-e27a-4a3d-8218-8e4699e52e38 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 620.199874] env[65427]: INFO networking_nsxv3.common.synchronization [req-e0780e81-7202-4b7c-b0a2-d8db5c2d76cc req-97319312-e27a-4a3d-8218-8e4699e52e38 service nova] Enqueued Resource ID: 7eecdc42-c890-467c-9c15-bbe0a2016860 with Priority: HIGHEST for action port [ 620.200460] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 620.200629] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 620.200629] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eecdc42-c890-467c-9c15-bbe0a2016860 with Priority: HIGHEST for action port [ 620.203357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.203357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.203357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.203357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.203357] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.203357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.204031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.204031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.204031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.204118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.204752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.204752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.204752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.204752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.204752] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.205435] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eecdc42-c890-467c-9c15-bbe0a2016860 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.205634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.205634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.205788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.205843] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecdc42-c890-467c-9c15-bbe0a2016860',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.641088] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: SUCCESS [ 620.642177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.642308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.642454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.642680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.642942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.642942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.643507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.643507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.643507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.643507] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.707392] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.708488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.708647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.710643] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eecdc42-c890-467c-9c15-bbe0a2016860 with status ACTIVE [ 620.710643] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.710794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.710848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.711125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.711194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.711380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.711531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.711578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.711798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.711798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.712342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.712342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.712458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.712639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.712793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.712933] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eecdc42-c890-467c-9c15-bbe0a2016860 is going to be updated. [ 620.736108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.736279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.736344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.736543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.736677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.736841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eecdc42-c890-467c-9c15-bbe0a2016860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.873408] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.873408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.873408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.873408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.874465] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.875763] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.875966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.876267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.876440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.876635] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.876743] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.876848] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.876951] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.877071] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.877177] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.877312] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.901439] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.901439] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.901439] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.901439] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.901439] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-a1fd87de-2584-4145-9901-2f5299eca032 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.903477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.903477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.903477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.903477] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fd87de-2584-4145-9901-2f5299eca032',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.147185] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.209992] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.404935] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.405391] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.405391] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.405584] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.405732] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.405881] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port a1fd87de-2584-4145-9901-2f5299eca032 not found, creating... [ 621.406246] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.406337] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.406415] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.406621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.406752] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.407028] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.407182] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.407294] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.407519] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.407684] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.407821] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: a1fd87de-2584-4145-9901-2f5299eca032 is going to be created. [ 621.428789] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.429192] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.429192] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.429425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.429653] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.429858] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.487696] env[65427]: INFO networking_nsxv3.common.synchronization [None req-1b23cdb1-6fe9-445f-8e5a-88e0d1a4634c None None] Enqueued Resource ID: df37285b-fb6e-4801-b810-1ed6406763b1 with Priority: HIGHEST for action port [ 621.488290] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df37285b-fb6e-4801-b810-1ed6406763b1 with Priority: HIGHEST for action port [ 621.488599] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-df37285b-fb6e-4801-b810-1ed6406763b1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.488723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df37285b-fb6e-4801-b810-1ed6406763b1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.488792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df37285b-fb6e-4801-b810-1ed6406763b1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.489337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df37285b-fb6e-4801-b810-1ed6406763b1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.489452] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df37285b-fb6e-4801-b810-1ed6406763b1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.649310] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 008bf551-bcd7-451b-8250-579db77bad7d: rpc.has_security_group_logging(os_id): False [ 621.675627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.675832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.675881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.676106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.676199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.676438] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.676550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.676604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.676745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.676819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.676906] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008bf551-bcd7-451b-8250-579db77bad7d is going to be created. [ 621.713300] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.713520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.713584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.713794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.713881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.713989] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be created. [ 621.738788] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.738972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.739031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.739230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.739390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.749871] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: UNINITIALIZED for 2s [ 621.760067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.760275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.760275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.760509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.760682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.775334] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: IN_PROGRESS for 2s [ 621.993734] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df37285b-fb6e-4801-b810-1ed6406763b1 [ 621.993929] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.993929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.994047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.994681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.994681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.994681] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df37285b-fb6e-4801-b810-1ed6406763b1 already deleted. [ 621.994681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df37285b-fb6e-4801-b810-1ed6406763b1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.177323] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b208d7-56a1-4a63-98e0-9c380805ae5f req-212e9545-44cd-4218-8746-3655e26edd86 service nova] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 622.177545] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b208d7-56a1-4a63-98e0-9c380805ae5f req-212e9545-44cd-4218-8746-3655e26edd86 service nova] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 622.177699] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b208d7-56a1-4a63-98e0-9c380805ae5f req-212e9545-44cd-4218-8746-3655e26edd86 service nova] Enqueued Resource ID: a1fd87de-2584-4145-9901-2f5299eca032 with Priority: HIGHEST for action port [ 622.178175] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 622.178311] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 622.178414] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1fd87de-2584-4145-9901-2f5299eca032 with Priority: HIGHEST for action port [ 622.178675] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.178786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.178851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.179917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.180061] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.181510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.181510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.185157] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.185157] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.185157] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1fd87de-2584-4145-9901-2f5299eca032 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.185157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.185157] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fd87de-2584-4145-9901-2f5299eca032',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.695383] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1fd87de-2584-4145-9901-2f5299eca032 with status ACTIVE [ 622.695383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.695383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.695383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.695383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.697140] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1fd87de-2584-4145-9901-2f5299eca032 is going to be updated. [ 622.697918] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.698058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.698383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.721308] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.721442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.721557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.721718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.721853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.725561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.020341] env[65427]: INFO networking_nsxv3.common.synchronization [req-94c3a036-07c1-466c-ab93-aab00293e914 req-52f57262-3fbc-4285-b7f5-80615b8aa4a4 tempest-ServerAddressesNegativeTestJSON-2092879524 tempest-ServerAddressesNegativeTestJSON-2092879524-project-member] Enqueued Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 623.020933] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 623.021737] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.021916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.021916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.022331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.022533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.022650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.022716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.024020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.024020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.024164] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.201169] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.467998] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2f87df5f-2d94-43f9-8e03-e4f86a98d57f None None] Enqueued Resource ID: 847bf5fe-40bb-4f4a-8667-6bd340272ca6 with Priority: HIGHEST for action port [ 623.468602] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847bf5fe-40bb-4f4a-8667-6bd340272ca6 with Priority: HIGHEST for action port [ 623.468920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-847bf5fe-40bb-4f4a-8667-6bd340272ca6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.469726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847bf5fe-40bb-4f4a-8667-6bd340272ca6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.469726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847bf5fe-40bb-4f4a-8667-6bd340272ca6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.469726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847bf5fe-40bb-4f4a-8667-6bd340272ca6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.469726] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847bf5fe-40bb-4f4a-8667-6bd340272ca6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.528865] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.529083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.529198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.531058] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.531058] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 already deleted. [ 623.531058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.628209] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.628408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-961" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.628531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-961" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.628867] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-961" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.629155] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.629314] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.629431] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.631056] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.631912] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.631912] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.631912] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.631912] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.631912] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.632124] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.632124] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.632558] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.655031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.655031] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.655242] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.655331] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-961" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.655679] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.655840] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.655951] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.656511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.656511] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc3fdff-14e1-4e32-ab7d-2730edceeeab',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.703896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.703896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.704292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.704399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.704457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.704536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be created. [ 623.732627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.732788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.732873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.733139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.733314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.746102] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: UNINITIALIZED for 2s [ 623.760346] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 623.760346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.760726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.760781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.761081] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.761196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.761236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.761437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.761521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.761620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.761722] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.792047] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: SUCCESS [ 623.792182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.971975] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 847bf5fe-40bb-4f4a-8667-6bd340272ca6 [ 623.972340] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.972527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.972596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.972856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.972950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.973029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:847bf5fe-40bb-4f4a-8667-6bd340272ca6 already deleted. [ 623.973085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847bf5fe-40bb-4f4a-8667-6bd340272ca6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.148647] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9edd70a7-2d06-4613-ad3d-bc517b447b64 None None] Enqueued Resource ID: 8756338d-5302-4e04-b70a-ca9042f29212 with Priority: HIGHEST for action port [ 624.148647] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8756338d-5302-4e04-b70a-ca9042f29212 with Priority: HIGHEST for action port [ 624.149506] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8756338d-5302-4e04-b70a-ca9042f29212 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.149506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8756338d-5302-4e04-b70a-ca9042f29212" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.149675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8756338d-5302-4e04-b70a-ca9042f29212" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.149964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8756338d-5302-4e04-b70a-ca9042f29212" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.150068] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8756338d-5302-4e04-b70a-ca9042f29212',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.159018] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.159235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.159356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.159675] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.159830] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.159982] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port ccc3fdff-14e1-4e32-ab7d-2730edceeeab not found, creating... [ 624.160265] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.160423] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.160536] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.160755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.160887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.161174] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.161326] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.161444] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.161647] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.161781] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.161929] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: ccc3fdff-14e1-4e32-ab7d-2730edceeeab is going to be created. [ 624.185444] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.185694] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.185796] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.186695] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.186695] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.187110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.266212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.266402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.266510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.266676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.266852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.267115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.267115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.267249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.267306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.267358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.267507] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.267602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.267660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.267805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.267967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.268049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.268099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.268226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.268300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.268382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.268473] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.392074] env[65427]: INFO networking_nsxv3.common.synchronization [None req-efe3db8f-e2ae-4d8e-84a9-e362da8e7a1a None None] Enqueued Resource ID: 6c3cea17-7bc7-4f83-8bef-551e89b399a7 with Priority: HIGHEST for action port [ 624.392784] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3cea17-7bc7-4f83-8bef-551e89b399a7 with Priority: HIGHEST for action port [ 624.393750] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c3cea17-7bc7-4f83-8bef-551e89b399a7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.393750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c3cea17-7bc7-4f83-8bef-551e89b399a7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.393750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c3cea17-7bc7-4f83-8bef-551e89b399a7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.393750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c3cea17-7bc7-4f83-8bef-551e89b399a7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.393750] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c3cea17-7bc7-4f83-8bef-551e89b399a7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.652333] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8756338d-5302-4e04-b70a-ca9042f29212 [ 624.652614] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.653013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.653013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.653013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.653375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.653375] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8756338d-5302-4e04-b70a-ca9042f29212 already deleted. [ 624.653375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8756338d-5302-4e04-b70a-ca9042f29212" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.776100] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5de73072-1420-4348-9a8f-7aea1d3f3f89: rpc.has_security_group_logging(os_id): False [ 624.793910] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.794084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.794144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.794364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.794469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.794705] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.794806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.794880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.795057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.795129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.795314] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.795404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.795459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.795622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.795703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.795912] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.796017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.796117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.796229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.796307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.796409] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be created. [ 624.879821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.880065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.880065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.880260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.880510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896177] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c3cea17-7bc7-4f83-8bef-551e89b399a7 [ 624.896949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.897108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.897181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.897664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.901024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.901024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c3cea17-7bc7-4f83-8bef-551e89b399a7 already deleted. [ 624.901024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c3cea17-7bc7-4f83-8bef-551e89b399a7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.902118] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 624.963530] env[65427]: INFO networking_nsxv3.common.synchronization [req-94c3a036-07c1-466c-ab93-aab00293e914 req-81bf8d2e-ad4b-4e03-a76b-106c6e7eb91b service nova] Enqueued Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_rules [ 624.963982] env[65427]: INFO networking_nsxv3.common.synchronization [req-94c3a036-07c1-466c-ab93-aab00293e914 req-81bf8d2e-ad4b-4e03-a76b-106c6e7eb91b service nova] Enqueued Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 624.963982] env[65427]: INFO networking_nsxv3.common.synchronization [req-94c3a036-07c1-466c-ab93-aab00293e914 req-81bf8d2e-ad4b-4e03-a76b-106c6e7eb91b service nova] Enqueued Resource ID: ccc3fdff-14e1-4e32-ab7d-2730edceeeab with Priority: HIGHEST for action port [ 624.965790] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_rules [ 624.965790] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 624.965790] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc3fdff-14e1-4e32-ab7d-2730edceeeab with Priority: HIGHEST for action port [ 624.965790] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.965790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.965790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.966520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.966520] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.967402] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.971026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.971026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.971026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.971026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.971026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc3fdff-14e1-4e32-ab7d-2730edceeeab',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.475448] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccc3fdff-14e1-4e32-ab7d-2730edceeeab with status ACTIVE [ 625.475907] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.475907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.475907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.476855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.477195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.477396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.477558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.477654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.477911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.478046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.478342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.478625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.478625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.478800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.478908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.480368] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccc3fdff-14e1-4e32-ab7d-2730edceeeab is going to be updated. [ 625.482179] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.482428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.482843] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.513703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.513703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.513703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.513703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.513703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.513703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccc3fdff-14e1-4e32-ab7d-2730edceeeab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.523137] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a3c6b8d-a1cb-4a4e-8e24-113ef642ac48 req-deec97f2-10c4-415c-8187-561b83641a7c tempest-ImagesNegativeTestJSON-1982853482 tempest-ImagesNegativeTestJSON-1982853482-project-member] Enqueued Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 625.523137] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 625.523137] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.523137] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.523137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.523137] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.757695] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: SUCCESS [ 625.758021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.758154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.758376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.758577] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.758696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.758789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.758907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.759052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.759095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.759218] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.911016] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-461 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.911219] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-461" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.911372] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-461" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.911761] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-461" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.912557] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.912557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.912557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.912557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.912722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.912909] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.913018] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.913135] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.913224] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.913324] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.913442] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.913549] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.935332] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.935911] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.936847] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.936847] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-461" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.937187] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.937733] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.937733] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.937963] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.938220] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1d94e1-1afd-4c11-bb8f-11a5b4561d05',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.986391] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.025089] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.025330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.025497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.025838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.026020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.026391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.026573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.026727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.027017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.027205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.027393] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 already deleted. [ 626.027564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.054391] env[65427]: INFO networking_nsxv3.common.synchronization [None req-1142f1e6-cc0a-4ad8-90b6-ab0c2ea9428d None None] Enqueued Resource ID: 23c7ee7c-ee11-4d6b-b24d-863eefd59206 with Priority: HIGHEST for action port [ 626.055055] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c7ee7c-ee11-4d6b-b24d-863eefd59206 with Priority: HIGHEST for action port [ 626.055580] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c7ee7c-ee11-4d6b-b24d-863eefd59206 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.055580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c7ee7c-ee11-4d6b-b24d-863eefd59206" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.056743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c7ee7c-ee11-4d6b-b24d-863eefd59206" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.056743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c7ee7c-ee11-4d6b-b24d-863eefd59206" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.056743] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c7ee7c-ee11-4d6b-b24d-863eefd59206',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.118014] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ef3eacd3-e85c-4c2b-b6b5-ef1642583e80 None None] Enqueued Resource ID: 4035b8de-d3bd-47b3-8ec6-f13dc992fc34 with Priority: HIGHEST for action port [ 626.118614] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4035b8de-d3bd-47b3-8ec6-f13dc992fc34 with Priority: HIGHEST for action port [ 626.118930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4035b8de-d3bd-47b3-8ec6-f13dc992fc34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.119375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4035b8de-d3bd-47b3-8ec6-f13dc992fc34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.119464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4035b8de-d3bd-47b3-8ec6-f13dc992fc34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.119735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4035b8de-d3bd-47b3-8ec6-f13dc992fc34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.119880] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4035b8de-d3bd-47b3-8ec6-f13dc992fc34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.262177] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.281991] env[65427]: INFO networking_nsxv3.common.synchronization [req-564fb593-c2ea-4172-a343-7cf2ed11a326 req-72318019-405e-4bfd-b8d8-36d46a8d483a tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: 108833b7-e670-41da-a0a1-05dc3d214a23 with Priority: HIGHEST for action security_group_rules [ 626.282774] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108833b7-e670-41da-a0a1-05dc3d214a23 with Priority: HIGHEST for action security_group_rules [ 626.283904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108833b7-e670-41da-a0a1-05dc3d214a23 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.284063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108833b7-e670-41da-a0a1-05dc3d214a23" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.284131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108833b7-e670-41da-a0a1-05dc3d214a23" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.284560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108833b7-e670-41da-a0a1-05dc3d214a23" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.284672] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108833b7-e670-41da-a0a1-05dc3d214a23',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.443952] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.444286] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.444448] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.444862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.445139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.445373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 not found, creating... [ 626.445834] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.446309] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.446309] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.446439] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.446571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.446888] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.447099] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.447392] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.447533] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.447730] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.447809] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 is going to be created. [ 626.473911] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.475498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.475498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.475498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.475498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.475498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.489695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.490000] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.490146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.490490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.490622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.492483] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 is going to be created. [ 626.528866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.528866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.528866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.528866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.528866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.542983] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: UNINITIALIZED for 2s [ 626.558470] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23c7ee7c-ee11-4d6b-b24d-863eefd59206 [ 626.558741] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.558891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.558962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.559236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.559689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.559818] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23c7ee7c-ee11-4d6b-b24d-863eefd59206 already deleted. [ 626.559914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c7ee7c-ee11-4d6b-b24d-863eefd59206" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.623203] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4035b8de-d3bd-47b3-8ec6-f13dc992fc34 [ 626.623269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.623491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.623571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.623814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.623906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.624014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4035b8de-d3bd-47b3-8ec6-f13dc992fc34 already deleted. [ 626.624101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4035b8de-d3bd-47b3-8ec6-f13dc992fc34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.770407] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2caa26d9-b324-42d2-886a-42215d3c4faf: rpc.has_security_group_logging(os_id): False [ 626.806210] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.806460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.806557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.806868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.809053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.810979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.810979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.810979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.810979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.810979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.811294] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be created. [ 626.815460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.815460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.815460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.815460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.815460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.815460] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108833b7-e670-41da-a0a1-05dc3d214a23 already deleted. [ 626.815460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108833b7-e670-41da-a0a1-05dc3d214a23" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.908049] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.908218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.908285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.908488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.908664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.917859] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 626.918103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.919310] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: IN_PROGRESS for 2s [ 627.231482] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a3c6b8d-a1cb-4a4e-8e24-113ef642ac48 req-8afa0baf-2cd3-4db5-a67d-a926e46b8f43 service nova] Enqueued Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_rules [ 627.231482] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a3c6b8d-a1cb-4a4e-8e24-113ef642ac48 req-8afa0baf-2cd3-4db5-a67d-a926e46b8f43 service nova] Enqueued Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 627.231482] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a3c6b8d-a1cb-4a4e-8e24-113ef642ac48 req-8afa0baf-2cd3-4db5-a67d-a926e46b8f43 service nova] Enqueued Resource ID: 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 with Priority: HIGHEST for action port [ 627.231960] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_rules [ 627.232138] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 627.232224] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 with Priority: HIGHEST for action port [ 627.232566] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.232713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.232769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.233428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.234329] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.234954] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.235371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.235371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.235519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.235573] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.235665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.235724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.235869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.235955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.236059] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.237681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.237833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.237833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.238028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.238096] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1d94e1-1afd-4c11-bb8f-11a5b4561d05',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.738967] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.743577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 with status ACTIVE [ 627.744404] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.744404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.744404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.744404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.744404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.744751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.744751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.744751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.744751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.744915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.745036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.745300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.745300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.745365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.745435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.746038] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e1d94e1-1afd-4c11-bb8f-11a5b4561d05 is going to be updated. [ 627.746720] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.746833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.769821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.770050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.770101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.770927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.770927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.770927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1d94e1-1afd-4c11-bb8f-11a5b4561d05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.244584] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.555074] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: SUCCESS [ 628.555241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.555410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.555619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.555813] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.556041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.556041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.556166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.556239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.556320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.556415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.747201] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.750476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.750476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.750476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.750476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.750476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 is going to be created. [ 628.804827] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.805056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.805144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.805425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.805723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.817587] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: UNINITIALIZED for 2s [ 628.935987] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: SUCCESS [ 628.937095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.062631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.062631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.062631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.062631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.062631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.064884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.064884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.064884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.064884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.064884] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.566558] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 170e7804-bd59-4b8d-a494-3a73bf406102: rpc.has_security_group_logging(os_id): False [ 629.585987] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.587353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.587565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.587933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.588249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.590019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.590019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.590019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.590019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.593712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.593712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.593712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.593712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.593712] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 is going to be created. [ 629.662361] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.662361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.662361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.662361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.662361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.675280] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: IN_PROGRESS for 2s [ 630.830643] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: SUCCESS [ 630.831034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.831034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.831512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.831512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.831805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.831805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.832968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.832968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.832968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.832968] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.340561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.340561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.340561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.340561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.340561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.347157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.347157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.347157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.347157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.347157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.347157] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.690380] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: SUCCESS [ 631.690642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.852760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03d7ed4a-3466-430c-b324-25493c8ea5f4: rpc.has_security_group_logging(os_id): False [ 631.869385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.869628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.869719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.869926] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.870063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.870368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.870500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.870558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.870701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.870782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.871017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.871127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.871265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.871338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.871392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.871619] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.871717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.872381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.872555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.872669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.873272] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 is going to be created. [ 631.968080] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.970021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.970021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.970021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.970021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.985556] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: IN_PROGRESS for 2s [ 632.079025] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ff79857b-d12e-49b6-ae6e-bb331c4e3de1 None None] Enqueued Resource ID: 7d2babbc-3537-415f-b25a-084b6bf62726 with Priority: HIGHEST for action port [ 632.079025] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d2babbc-3537-415f-b25a-084b6bf62726 with Priority: HIGHEST for action port [ 632.079025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d2babbc-3537-415f-b25a-084b6bf62726 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.079025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d2babbc-3537-415f-b25a-084b6bf62726" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.079025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d2babbc-3537-415f-b25a-084b6bf62726" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.081130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d2babbc-3537-415f-b25a-084b6bf62726" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.081130] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d2babbc-3537-415f-b25a-084b6bf62726',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.586663] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d2babbc-3537-415f-b25a-084b6bf62726 [ 632.586663] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.586663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.586663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.586663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.586663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.586663] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d2babbc-3537-415f-b25a-084b6bf62726 already deleted. [ 632.586663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d2babbc-3537-415f-b25a-084b6bf62726" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.597411] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f144cc4f-d5ab-4ac3-9f74-18ca27e43f6c None None] Enqueued Resource ID: 26ea91e3-4793-4526-b917-4ab03192fe80 with Priority: HIGHEST for action port [ 633.597862] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ea91e3-4793-4526-b917-4ab03192fe80 with Priority: HIGHEST for action port [ 633.598206] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-26ea91e3-4793-4526-b917-4ab03192fe80 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.598325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26ea91e3-4793-4526-b917-4ab03192fe80" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.598391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26ea91e3-4793-4526-b917-4ab03192fe80" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.598654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26ea91e3-4793-4526-b917-4ab03192fe80" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.598742] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26ea91e3-4793-4526-b917-4ab03192fe80',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.930689] env[65427]: INFO networking_nsxv3.common.synchronization [req-cdb70914-8823-46cb-a9d8-7fde3341e3d3 req-e49e8885-18ce-4a1d-8b5c-bdaf8e412e39 tempest-ServerExternalEventsTest-1987515865 tempest-ServerExternalEventsTest-1987515865-project-member] Enqueued Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 633.931374] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGHEST for action security_group_members [ 633.931634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.931761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.931825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.932233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.932445] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.932562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.932623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.932876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.932973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.933085] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.008620] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: SUCCESS [ 634.008620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.102787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26ea91e3-4793-4526-b917-4ab03192fe80 [ 634.105142] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.105142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.105142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.105142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.105142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.105142] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26ea91e3-4793-4526-b917-4ab03192fe80 already deleted. [ 634.105142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26ea91e3-4793-4526-b917-4ab03192fe80" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.437183] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.437183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.437183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.437183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.437183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.437183] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.437183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.439460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.439694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.439784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439885] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d is going to be updated. [ 634.468841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.468938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.469671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.469671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.469671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.479869] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: IN_PROGRESS for 2s [ 634.694220] env[65427]: INFO networking_nsxv3.common.synchronization [None req-aed5b2c2-1059-4dba-9499-007efab91750 None None] Enqueued Resource ID: a04af086-1142-4621-b63d-485ed512d89c with Priority: HIGHEST for action port [ 634.695455] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04af086-1142-4621-b63d-485ed512d89c with Priority: HIGHEST for action port [ 634.696356] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a04af086-1142-4621-b63d-485ed512d89c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.696511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a04af086-1142-4621-b63d-485ed512d89c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.696657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a04af086-1142-4621-b63d-485ed512d89c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.697379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a04af086-1142-4621-b63d-485ed512d89c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.698033] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a04af086-1142-4621-b63d-485ed512d89c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.891700] env[65427]: INFO networking_nsxv3.common.synchronization [req-a8a23455-3c8e-409b-b085-12c16579d3b6 req-c84f73f7-6bd4-4a41-9f67-c102133a1650 tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 634.892268] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 634.892628] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.892770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.892841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.894300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.894798] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.894798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.894798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.895219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.895219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.895219] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.200940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a04af086-1142-4621-b63d-485ed512d89c [ 635.200940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.200940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.200940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.200940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.200940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.200940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a04af086-1142-4621-b63d-485ed512d89c already deleted. [ 635.200940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a04af086-1142-4621-b63d-485ed512d89c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.355881] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.356094] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.356215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.356629] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.356883] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.357063] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.357201] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.357427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.357569] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.358143] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.358143] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.358143] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.358143] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.358322] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.358563] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.358563] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.379077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.379376] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.379482] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.379712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.380137] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-357a5f5c-41e3-4725-83b4-0ed645435c3a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.380387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.380553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.380957] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.381383] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357a5f5c-41e3-4725-83b4-0ed645435c3a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.397551] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.885155] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.886057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.886057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.886406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.886406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.886406] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 357a5f5c-41e3-4725-83b4-0ed645435c3a not found, creating... [ 635.886639] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.886791] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.886902] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.887136] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.887267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.887541] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.887692] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.887804] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.887999] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.888954] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.888954] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 357a5f5c-41e3-4725-83b4-0ed645435c3a is going to be created. [ 635.904197] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.909048] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.909266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.909387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.909663] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.909888] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.910111] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.407421] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.407541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.407584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.407879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.407954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.408075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 636.445710] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.445958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.446067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.447162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.447162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.458491] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 636.509275] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d in Status: SUCCESS [ 636.509275] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d deletion is rescheduled due to dependency. [ 636.509275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.674283] env[65427]: INFO networking_nsxv3.common.synchronization [req-a8a23455-3c8e-409b-b085-12c16579d3b6 req-ae462167-271e-4b34-941c-5046cb6d3eb9 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 636.674459] env[65427]: INFO networking_nsxv3.common.synchronization [req-a8a23455-3c8e-409b-b085-12c16579d3b6 req-ae462167-271e-4b34-941c-5046cb6d3eb9 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 636.674591] env[65427]: INFO networking_nsxv3.common.synchronization [req-a8a23455-3c8e-409b-b085-12c16579d3b6 req-ae462167-271e-4b34-941c-5046cb6d3eb9 service nova] Enqueued Resource ID: 357a5f5c-41e3-4725-83b4-0ed645435c3a with Priority: HIGHEST for action port [ 636.675432] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 636.675432] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 636.675619] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357a5f5c-41e3-4725-83b4-0ed645435c3a with Priority: HIGHEST for action port [ 636.675825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.676255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.676255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.676255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.676815] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.677453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.677453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.677620] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-357a5f5c-41e3-4725-83b4-0ed645435c3a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.677620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.677754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.678056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.678056] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357a5f5c-41e3-4725-83b4-0ed645435c3a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.183252] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.183564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.183696] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 357a5f5c-41e3-4725-83b4-0ed645435c3a with status ACTIVE [ 637.183957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.184106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.184177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.184560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.184560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.184691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.184862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.184933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.185233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.185386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.185665] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.185786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.185842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.187647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.187884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.187884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 357a5f5c-41e3-4725-83b4-0ed645435c3a is going to be updated. [ 637.216441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.216441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.216441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.216773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.217339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.217339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-357a5f5c-41e3-4725-83b4-0ed645435c3a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.303018] env[65427]: INFO networking_nsxv3.common.synchronization [None req-dd2ab5e8-fa56-4c46-8695-3df15b00c475 None None] Enqueued Resource ID: 76b549a0-024f-46ab-9bc3-cb7422a68a49 with Priority: HIGHEST for action port [ 637.303018] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76b549a0-024f-46ab-9bc3-cb7422a68a49 with Priority: HIGHEST for action port [ 637.303018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-76b549a0-024f-46ab-9bc3-cb7422a68a49 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.303018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76b549a0-024f-46ab-9bc3-cb7422a68a49" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.303018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76b549a0-024f-46ab-9bc3-cb7422a68a49" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.303018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76b549a0-024f-46ab-9bc3-cb7422a68a49" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.303018] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76b549a0-024f-46ab-9bc3-cb7422a68a49',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.363176] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2e71d7dd-f859-4a9a-802a-a924df53d969 None None] Enqueued Resource ID: 85732cfe-9eb1-4142-b22d-5d33f351819f with Priority: HIGHEST for action port [ 637.363591] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85732cfe-9eb1-4142-b22d-5d33f351819f with Priority: HIGHEST for action port [ 637.363995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-85732cfe-9eb1-4142-b22d-5d33f351819f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.364864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85732cfe-9eb1-4142-b22d-5d33f351819f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.364977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85732cfe-9eb1-4142-b22d-5d33f351819f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.365295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85732cfe-9eb1-4142-b22d-5d33f351819f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.365403] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85732cfe-9eb1-4142-b22d-5d33f351819f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.750225] env[65427]: INFO networking_nsxv3.common.synchronization [req-484fba0e-8706-4b9e-9f4f-d28f641c99f8 req-93ac6f19-c21c-45b5-a837-06915fe58bc3 tempest-FloatingIPsAssociationNegativeTestJSON-1990844324 tempest-FloatingIPsAssociationNegativeTestJSON-1990844324-project-member] Enqueued Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 637.750225] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 637.751097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.751097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.751097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.751097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.751401] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.751692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.751827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.752054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.752200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.752365] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.807882] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76b549a0-024f-46ab-9bc3-cb7422a68a49 [ 637.807882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.807882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.807882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.807882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.808164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.808164] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76b549a0-024f-46ab-9bc3-cb7422a68a49 already deleted. [ 637.808234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76b549a0-024f-46ab-9bc3-cb7422a68a49" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.872207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85732cfe-9eb1-4142-b22d-5d33f351819f [ 637.873453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.873453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.873453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.873453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.873770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.873770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85732cfe-9eb1-4142-b22d-5d33f351819f already deleted. [ 637.873901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85732cfe-9eb1-4142-b22d-5d33f351819f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.188378] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a05f395d-4494-4251-82c2-c7484d564c6e tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 638.189443] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 638.189443] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.189443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.189443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.189760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.189910] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.250828] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.252223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-969" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.252223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-969" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.252223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-969" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.252512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.252696] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.252822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.253036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.253174] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.253372] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.253480] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.253630] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.253774] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.253862] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.253965] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.254107] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.255788] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.256319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.256445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.256714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.256805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.256998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.257107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.257170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.257328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.257407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.257495] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 already deleted. [ 638.257574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.276688] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.276884] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.277029] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.277202] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-969" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.277510] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-9c7b6d7f-984a-41ca-b155-90475796f351 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.277678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.277792] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.278153] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.278244] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c7b6d7f-984a-41ca-b155-90475796f351',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.469947] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 638.470236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.471108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.471108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.471108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.471335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.471335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.471514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.471600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.471702] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.487688] env[65427]: INFO networking_nsxv3.common.synchronization [None req-cc57384a-f65b-4e20-882b-b28b07d299d2 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 638.487688] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 638.487841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.487896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.714457] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.714707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.714707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.714937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.715165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.715165] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f already deleted. [ 638.715264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.715363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.715525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.715613] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.782043] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.782043] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.782297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.782389] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.782574] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.782726] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 9c7b6d7f-984a-41ca-b155-90475796f351 not found, creating... [ 638.782998] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.783195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.783474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.783608] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.783708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.784009] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.784172] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.784286] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.784504] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.784640] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.784795] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 9c7b6d7f-984a-41ca-b155-90475796f351 is going to be created. [ 638.808301] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.808668] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.808822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.809136] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.810068] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.810336] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.851228] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a360a007-5b42-45ee-9e30-bc4813ac8571 None None] Enqueued Resource ID: 90173ec7-f668-4eff-b6ae-bc9e4262f0fa with Priority: HIGHEST for action port [ 638.851807] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90173ec7-f668-4eff-b6ae-bc9e4262f0fa with Priority: HIGHEST for action port [ 638.852200] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-90173ec7-f668-4eff-b6ae-bc9e4262f0fa taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.852329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90173ec7-f668-4eff-b6ae-bc9e4262f0fa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.852435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90173ec7-f668-4eff-b6ae-bc9e4262f0fa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.852739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90173ec7-f668-4eff-b6ae-bc9e4262f0fa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.852863] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90173ec7-f668-4eff-b6ae-bc9e4262f0fa',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.860643] env[65427]: INFO networking_nsxv3.common.synchronization [req-b659dfab-65fc-4ab9-b3fc-0aae9905e879 req-b53ebd58-1fe9-4524-828b-18f90e320cde tempest-ServerDiagnosticsTest-18153023 tempest-ServerDiagnosticsTest-18153023-project-member] Enqueued Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 638.861355] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGHEST for action security_group_members [ 638.861604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.861735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.861806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.861993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.862178] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.862272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.862330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.862505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.862660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.862726] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.973983] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.241094] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.241427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.241427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.241532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.241619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.241722] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f already deleted. [ 639.241825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.355259] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90173ec7-f668-4eff-b6ae-bc9e4262f0fa [ 639.355259] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.356597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.356597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.356773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.356773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.356909] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90173ec7-f668-4eff-b6ae-bc9e4262f0fa already deleted. [ 639.356909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90173ec7-f668-4eff-b6ae-bc9e4262f0fa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.366391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.366634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.366634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.366848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.366939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.367180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.367305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.367363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.367530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.367611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.367703] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd is going to be updated. [ 639.406770] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.411095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.411095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.411095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.411095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.422856] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: IN_PROGRESS for 2s [ 639.478851] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.590428] env[65427]: INFO networking_nsxv3.common.synchronization [req-484fba0e-8706-4b9e-9f4f-d28f641c99f8 req-ffbf469e-4ea0-420c-8dc6-9b37c0469a76 service nova] Enqueued Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_rules [ 639.590746] env[65427]: INFO networking_nsxv3.common.synchronization [req-484fba0e-8706-4b9e-9f4f-d28f641c99f8 req-ffbf469e-4ea0-420c-8dc6-9b37c0469a76 service nova] Enqueued Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 639.593568] env[65427]: INFO networking_nsxv3.common.synchronization [req-484fba0e-8706-4b9e-9f4f-d28f641c99f8 req-ffbf469e-4ea0-420c-8dc6-9b37c0469a76 service nova] Enqueued Resource ID: 9c7b6d7f-984a-41ca-b155-90475796f351 with Priority: HIGHEST for action port [ 639.593964] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_rules [ 639.594142] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 639.594241] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c7b6d7f-984a-41ca-b155-90475796f351 with Priority: HIGHEST for action port [ 639.594586] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.594725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.594792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.595103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.595187] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.596130] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.596241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.596384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.596850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.596850] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.596850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.596850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.597056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.598882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.599334] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.601346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c7b6d7f-984a-41ca-b155-90475796f351 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.601509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.601660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.602015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.602015] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c7b6d7f-984a-41ca-b155-90475796f351',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.964995] env[65427]: INFO networking_nsxv3.common.synchronization [req-bfc630d9-f420-4380-867e-b861629b4571 req-74436b63-4baf-4024-92d7-a7cea5018df4 tempest-AttachInterfacesV270Test-458599612 tempest-AttachInterfacesV270Test-458599612-project-member] Enqueued Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 639.965592] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 639.965902] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.966431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.966570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.966860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.967069] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.967205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.967273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.967586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.967586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.967712] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.982118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.982348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.982348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.982595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.982691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.982786] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 640.016452] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.016602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.016680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.016911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.017070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.035313] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 640.104731] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.104865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.105069] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.105978] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c7b6d7f-984a-41ca-b155-90475796f351 with status ACTIVE [ 640.106188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.106300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.106364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.106903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.106903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.106903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.106903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.107115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.108362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.108404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.108611] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.108720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.110822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.110822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.110822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.110822] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c7b6d7f-984a-41ca-b155-90475796f351 is going to be updated. [ 640.134829] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.135075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.135164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.135421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.135575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.135746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c7b6d7f-984a-41ca-b155-90475796f351" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.398173] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.398556] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-786" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.398556] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-786" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.398922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-786" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.399308] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.399482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.399904] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.399904] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.400021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.400173] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.400279] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.400566] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.400721] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.400872] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.401030] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.401190] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.431410] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.431577] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.431709] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.431881] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-786" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.432219] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-c417485f-293f-4cd4-8150-8cf44ce2da0a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.432389] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.432695] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.433189] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.433382] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c417485f-293f-4cd4-8150-8cf44ce2da0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.469686] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.469918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.469918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.470136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.470229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.470515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.470630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.470696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.470857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.470934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.471037] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 already deleted. [ 640.471116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.611510] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.935845] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.936110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.936222] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.936522] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.936651] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.936804] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port c417485f-293f-4cd4-8150-8cf44ce2da0a not found, creating... [ 640.937083] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.937259] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.937386] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.937647] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.937868] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.938119] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.938211] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.938615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.938615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.938711] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.939353] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: c417485f-293f-4cd4-8150-8cf44ce2da0a is going to be created. [ 640.963362] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.963812] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.963812] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.964039] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.964278] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.964486] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.114827] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.115011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.115056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.116630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.116630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.116630] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 is going to be created. [ 641.158934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.158934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.158934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.158934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.158934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.168476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: UNINITIALIZED for 2s [ 641.439840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e08d6a87-c5be-4f46-9078-9a60601143bd in Status: SUCCESS [ 641.439840] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd deletion is rescheduled due to dependency. [ 641.439840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693597] env[65427]: INFO networking_nsxv3.common.synchronization [req-bfc630d9-f420-4380-867e-b861629b4571 req-825c1c0a-9aa1-4e4e-ada2-da327132649f service nova] Enqueued Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_rules [ 641.693597] env[65427]: INFO networking_nsxv3.common.synchronization [req-bfc630d9-f420-4380-867e-b861629b4571 req-825c1c0a-9aa1-4e4e-ada2-da327132649f service nova] Enqueued Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 641.693597] env[65427]: INFO networking_nsxv3.common.synchronization [req-bfc630d9-f420-4380-867e-b861629b4571 req-825c1c0a-9aa1-4e4e-ada2-da327132649f service nova] Enqueued Resource ID: c417485f-293f-4cd4-8150-8cf44ce2da0a with Priority: HIGHEST for action port [ 641.693597] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_rules [ 641.694544] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 641.694876] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c417485f-293f-4cd4-8150-8cf44ce2da0a with Priority: HIGHEST for action port [ 641.698171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.698171] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.698171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.698171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.698171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.698171] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.706237] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c417485f-293f-4cd4-8150-8cf44ce2da0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.706729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.706983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.707402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.707660] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c417485f-293f-4cd4-8150-8cf44ce2da0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.046612] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 642.046912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.047136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.047361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.047559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.047734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.047734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.047901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.047971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.048078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.048164] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.210010] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.210666] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.211717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.211717] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c417485f-293f-4cd4-8150-8cf44ce2da0a with status ACTIVE [ 642.211842] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.211908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.211949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.212167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.212254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.212437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.212612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.212673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.212840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.212915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.214026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.215237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.215237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.215237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.215237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.215237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c417485f-293f-4cd4-8150-8cf44ce2da0a is going to be updated. [ 642.240515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.240729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.240729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.240924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.241090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.241290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c417485f-293f-4cd4-8150-8cf44ce2da0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.274959] env[65427]: INFO networking_nsxv3.common.synchronization [req-ab2d0481-09bb-46cc-833c-60a70d71aa49 req-1673a68b-d348-4e53-85c7-5920f0e0b180 tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 642.274959] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 642.276044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.276044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.276044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.276044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.276044] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5f0c9b5-5e89-49c6-baa2-5df45e369e48',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.551560] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.551916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.551916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.552040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.552221] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.552328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.552392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.552585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.552690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.552823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.553048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.553172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.553250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.553411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.553558] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.553702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.553751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.553888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.553992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.554102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.554189] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.595693] env[65427]: INFO networking_nsxv3.common.synchronization [req-189b98a3-55f1-4a8b-b27c-7946af340532 req-78d160ae-1551-4476-818e-aec145b20a94 tempest-ServerPasswordTestJSON-705140258 tempest-ServerPasswordTestJSON-705140258-project-member] Enqueued Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 642.596853] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 642.600452] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.600452] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.600452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.600452] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.713279] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.801236] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.801424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.801497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.801764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.801873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.801974] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 already deleted. [ 642.802088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.977209] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-230 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.977209] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-230" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.977209] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-230" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.977209] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-230" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.978027] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.978774] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.978774] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.979183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.981287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.981287] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.981287] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.981287] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.981287] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.981287] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.981287] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.981287] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.000559] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.000771] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.000984] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.001133] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-230" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.001518] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-46a123cc-55db-4bba-bd53-643c60fbac34 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.001716] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.001849] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.002205] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.002351] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a123cc-55db-4bba-bd53-643c60fbac34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.056916] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5de73072-1420-4348-9a8f-7aea1d3f3f89: rpc.has_security_group_logging(os_id): False [ 643.081409] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.082262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.082386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.085039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.085039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.085039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.085218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.085218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.085452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.086021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.086123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.086261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.086338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.086804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.086907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.087234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.087417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.087480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.087618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.087701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.087794] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 643.101459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.101617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.101690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.101927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.102070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.102234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.102375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.102538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.102884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.102884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.103024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 already deleted. [ 643.103130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.177638] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.177894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.177894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.178679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.178679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.180589] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: SUCCESS [ 643.180780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.180941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.181169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.181377] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.181505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.181579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.181746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.181827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.181913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.182012] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.196043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 643.214687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.214871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.214948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.215220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.215314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.215420] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 is going to be created. [ 643.282104] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.282104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.282104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.282104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.282104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.294263] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: UNINITIALIZED for 2s [ 643.505436] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.505744] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.506027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.506341] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.506341] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.506550] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 46a123cc-55db-4bba-bd53-643c60fbac34 not found, creating... [ 643.506871] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.507108] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.507444] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.507844] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.507844] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.509225] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.509225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.509225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.509225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.509225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.509225] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 46a123cc-55db-4bba-bd53-643c60fbac34 is going to be created. [ 643.539217] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.540526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.540526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.540526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.540526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.540767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.684269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.684707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.684707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.684877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.685175] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.685341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.685417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.685635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.685727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.685817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.685990] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.686123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.686201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.686344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.686504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.686629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.686685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.686797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.686875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.686982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.687110] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.190140] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 974a55e0-fc07-407b-9d34-07e598ec3f15: rpc.has_security_group_logging(os_id): False [ 644.205310] env[65427]: INFO networking_nsxv3.common.synchronization [req-7c97c9f7-f5d8-470c-b674-5db0dc883203 req-289c88c8-a6ca-450f-b1de-66ea55667e1d tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 644.206288] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 644.206838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.207342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.207432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.207883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.207974] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5f0c9b5-5e89-49c6-baa2-5df45e369e48',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.211252] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.211378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.211378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.211745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.211745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.212184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.212184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.212184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.212184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.212619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.212619] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.212619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.213212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.213212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.213212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.213424] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.213577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.214041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.214249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.214337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.214424] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 is going to be created. [ 644.304685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.304685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.304685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.304980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.305195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.324612] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: IN_PROGRESS for 2s [ 644.384649] env[65427]: INFO networking_nsxv3.common.synchronization [req-189b98a3-55f1-4a8b-b27c-7946af340532 req-6b1fda1e-866a-432b-aa76-6a7f40c9ce30 service nova] Enqueued Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_rules [ 644.384957] env[65427]: INFO networking_nsxv3.common.synchronization [req-189b98a3-55f1-4a8b-b27c-7946af340532 req-6b1fda1e-866a-432b-aa76-6a7f40c9ce30 service nova] Enqueued Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 644.385424] env[65427]: INFO networking_nsxv3.common.synchronization [req-189b98a3-55f1-4a8b-b27c-7946af340532 req-6b1fda1e-866a-432b-aa76-6a7f40c9ce30 service nova] Enqueued Resource ID: 46a123cc-55db-4bba-bd53-643c60fbac34 with Priority: HIGHEST for action port [ 644.386468] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_rules [ 644.386677] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 644.386858] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a123cc-55db-4bba-bd53-643c60fbac34 with Priority: HIGHEST for action port [ 644.387174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.387318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.387461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.387847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.387965] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.390016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.390166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.390311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.390588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.390903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.390963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.391000] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.391302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.391398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.391544] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.392574] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a123cc-55db-4bba-bd53-643c60fbac34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.392698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.392767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.392959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.393173] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a123cc-55db-4bba-bd53-643c60fbac34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.732655] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.733466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.733466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.733466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.733466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.733466] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 already deleted. [ 644.733466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.891350] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.891625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.895944] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.897931] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46a123cc-55db-4bba-bd53-643c60fbac34 with status ACTIVE [ 644.897931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.897931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.897931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.897931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.897931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.898339] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.898339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.898339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.898339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.898339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.898544] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.898684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.898684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.898800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.900737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.903732] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46a123cc-55db-4bba-bd53-643c60fbac34 is going to be updated. [ 644.929366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.929366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.929366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.929518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.929573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.929802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a123cc-55db-4bba-bd53-643c60fbac34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.197717] env[65427]: INFO networking_nsxv3.common.synchronization [req-f7d82a2a-84fa-480c-ad4a-c617450c65f8 req-17f35f75-07d4-4155-8058-dac8e20eae31 tempest-DeleteServersAdminTestJSON-1806482241 tempest-DeleteServersAdminTestJSON-1806482241-project-member] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 645.199689] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 645.200034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.200185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.200263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.201123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.201465] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.201817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.201919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.202084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.202168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.202258] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.218577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 645.218804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.304584] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: SUCCESS [ 645.304759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.304958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.305224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.305446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.305569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.305653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.307190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.307305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.307406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.307505] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.404604] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.705549] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.705755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.705824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.706109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.706240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.706458] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.706558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.706619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.706792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.706870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.706956] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be updated. [ 645.734779] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.735163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.735163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.735268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.735366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.742746] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.742942] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.743168] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.743348] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.743617] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.743792] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.743908] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.744164] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.744305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.744511] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.744620] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.744725] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.744827] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.744932] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.745049] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.745194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.755972] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 645.764124] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.764124] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.764471] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.764471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.764830] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-c572b778-3509-4098-a150-44555c97bd93 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.765039] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.765169] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.765544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.765700] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c572b778-3509-4098-a150-44555c97bd93',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.812838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.813030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.813098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.813312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.813494] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.813634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.813703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.813804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.813895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.813983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.814152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.814248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.814306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.814502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.814615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.814713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.814778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.814919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.814998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.815095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.815193] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.906580] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.906743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.906797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.907041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.907130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.907229] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 is going to be created. [ 645.933764] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.933918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.934472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.934472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.934472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.945301] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: UNINITIALIZED for 2s [ 646.268685] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.268924] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.269084] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.269366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.269516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.269681] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port c572b778-3509-4098-a150-44555c97bd93 not found, creating... [ 646.269938] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.270100] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.270215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.270442] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.270586] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.270868] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.271030] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.271135] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.271343] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.271473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.271609] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: c572b778-3509-4098-a150-44555c97bd93 is going to be created. [ 646.314772] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.315059] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.315206] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.315543] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.315785] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.316025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.318068] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89734b51-576f-441c-a85a-6861eb7a5b94: rpc.has_security_group_logging(os_id): False [ 646.364504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.364740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.364852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.365055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.365149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.365492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.365562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.365694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.365785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.365972] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.366103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.366150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.366275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.366352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.366535] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.366625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.366680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.366820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.366894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.366982] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 is going to be created. [ 646.372500] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: SUCCESS [ 646.372817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.478797] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.479021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.479079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.479267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.479457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.509151] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: IN_PROGRESS for 2s [ 646.900631] env[65427]: INFO networking_nsxv3.common.synchronization [req-6f297735-7d0e-422d-aa78-d97929cad9f1 req-292d3155-8950-4b9e-9020-54e5ad39a2c4 tempest-ImagesNegativeTestJSON-1982853482 tempest-ImagesNegativeTestJSON-1982853482-project-member] Enqueued Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 646.901426] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGHEST for action security_group_members [ 646.901867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.901867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.901867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.902182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.902386] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.902552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.902631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.902773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.902870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.903022] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.087740] env[65427]: INFO networking_nsxv3.common.synchronization [req-f7d82a2a-84fa-480c-ad4a-c617450c65f8 req-81512203-778c-41bf-90ce-791733b76b64 service nova] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_rules [ 647.088062] env[65427]: INFO networking_nsxv3.common.synchronization [req-f7d82a2a-84fa-480c-ad4a-c617450c65f8 req-81512203-778c-41bf-90ce-791733b76b64 service nova] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 647.088293] env[65427]: INFO networking_nsxv3.common.synchronization [req-f7d82a2a-84fa-480c-ad4a-c617450c65f8 req-81512203-778c-41bf-90ce-791733b76b64 service nova] Enqueued Resource ID: c572b778-3509-4098-a150-44555c97bd93 with Priority: HIGHEST for action port [ 647.088948] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_rules [ 647.089167] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 647.089341] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c572b778-3509-4098-a150-44555c97bd93 with Priority: HIGHEST for action port [ 647.089788] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.090066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.091298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.091298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.091298] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.093034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.093034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.093034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c572b778-3509-4098-a150-44555c97bd93 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.093034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.093034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.094331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.094408] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c572b778-3509-4098-a150-44555c97bd93',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.408951] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.409164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.409237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.409586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.409701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.409956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.410078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.410149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.410343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.410454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.410572] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 is going to be updated. [ 647.439644] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.439794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.439865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.440262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.440262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.455714] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: IN_PROGRESS for 2s [ 647.597503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.601275] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c572b778-3509-4098-a150-44555c97bd93 with status ACTIVE [ 647.601275] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.601275] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.601275] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.601275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.604165] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c572b778-3509-4098-a150-44555c97bd93 is going to be updated. [ 647.632544] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.633220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.633337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.634121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.634121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.634234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c572b778-3509-4098-a150-44555c97bd93" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.769382] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 647.769610] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee deletion is rescheduled due to dependency. [ 647.769731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.770104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.770231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.770523] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.770675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.770774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.770998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.771699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.771699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.957877] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: SUCCESS [ 647.957877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.958701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.958701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.958701] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.958861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.958929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.959171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.959339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.959482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.959622] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.275594] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.462993] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.463231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.463329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.463530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.463719] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.463826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.463871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.464047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.464137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.464232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.464402] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.464494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.464557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.464700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.464853] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.464960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.465907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.466150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.466322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.466450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.466524] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.521276] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: SUCCESS [ 648.521494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.776838] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.969692] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e987c094-a21a-43f5-a474-5ed1b1a855b6: rpc.has_security_group_logging(os_id): False [ 649.011224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.011224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.011224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.011224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.012094] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.012094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.012094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.012094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.012094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.012094] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 is going to be created. [ 649.094908] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.094908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.094908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.094908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.094908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.115485] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: IN_PROGRESS for 2s [ 649.281579] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.281752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.281817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.282073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.282173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.282276] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be updated. [ 649.320272] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.320379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.320494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.320842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.320965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.331527] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 649.468000] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 in Status: SUCCESS [ 649.468205] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 deletion is rescheduled due to dependency. [ 649.468328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.631495] env[65427]: INFO networking_nsxv3.common.synchronization [req-494afadd-2b69-457e-81ae-87ef1464b8a0 req-a879a1ee-1990-42f8-bce1-4ed17144d66e tempest-FloatingIPsAssociationTestJSON-904560228 tempest-FloatingIPsAssociationTestJSON-904560228-project-member] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 649.631495] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 649.631744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.631899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.632010] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.633038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.633319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.633463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.633536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.633754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.633844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.633942] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.138661] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.141727] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.142009] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.142171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.142480] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.142825] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.142995] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.146391] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.147989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.148094] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.149357] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.149357] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.150947] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.151124] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.151253] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.151421] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.151580] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.182246] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.182713] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.182713] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.182957] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-114" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.183269] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-85d35cfa-072c-4ecf-81f5-6c71255a27eb taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.183447] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.183565] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.183909] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.184729] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85d35cfa-072c-4ecf-81f5-6c71255a27eb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.657542] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.688531] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.688773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.688898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.689314] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.689474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.689630] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 85d35cfa-072c-4ecf-81f5-6c71255a27eb not found, creating... [ 650.689910] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.690094] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.691526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.691526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.691526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.691526] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.692389] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.692602] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.692839] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.692973] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.693127] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 85d35cfa-072c-4ecf-81f5-6c71255a27eb is going to be created. [ 650.716264] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.716482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.716605] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.716898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.717134] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.717354] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.129396] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: SUCCESS [ 651.129631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.159622] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.160022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.160022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.160104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.160147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.160230] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be updated. [ 651.193976] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.194232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.194352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.194698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.194939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.206389] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 651.341765] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 651.341963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.342164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.342467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.342735] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.342873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.342941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.343142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.343228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.343318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.343417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.438752] env[65427]: INFO networking_nsxv3.common.synchronization [req-494afadd-2b69-457e-81ae-87ef1464b8a0 req-f65d73cd-d696-4851-b9f4-a28afff51889 service nova] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_rules [ 651.438950] env[65427]: INFO networking_nsxv3.common.synchronization [req-494afadd-2b69-457e-81ae-87ef1464b8a0 req-f65d73cd-d696-4851-b9f4-a28afff51889 service nova] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 651.439078] env[65427]: INFO networking_nsxv3.common.synchronization [req-494afadd-2b69-457e-81ae-87ef1464b8a0 req-f65d73cd-d696-4851-b9f4-a28afff51889 service nova] Enqueued Resource ID: 85d35cfa-072c-4ecf-81f5-6c71255a27eb with Priority: HIGHEST for action port [ 651.439607] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_rules [ 651.439741] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 651.439838] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d35cfa-072c-4ecf-81f5-6c71255a27eb with Priority: HIGHEST for action port [ 651.440894] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.441041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.441103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.441302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.441391] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.442510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.442510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.442721] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-85d35cfa-072c-4ecf-81f5-6c71255a27eb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.442721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.442843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.442999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.443103] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85d35cfa-072c-4ecf-81f5-6c71255a27eb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.848472] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.848997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.848997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.849208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.849515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.849688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.849797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.850039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.850159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.850273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.850461] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.850698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.850698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.850927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.851155] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.851691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.851691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.851691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.851881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.851881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.851992] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.946348] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85d35cfa-072c-4ecf-81f5-6c71255a27eb with status ACTIVE [ 651.946583] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.946750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.946827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.947064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.950031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.950031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.950031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85d35cfa-072c-4ecf-81f5-6c71255a27eb is going to be updated. [ 651.950031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.950031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.980565] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.980795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.980795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.981093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.981206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.981546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85d35cfa-072c-4ecf-81f5-6c71255a27eb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.166984] env[65427]: INFO networking_nsxv3.common.synchronization [req-ed7c6554-ff03-4fa3-9e83-31a005c94d97 req-01cf9808-d354-4329-ae42-9c42aa73b09a tempest-SecurityGroupRulesTestJSON-1600698118 tempest-SecurityGroupRulesTestJSON-1600698118-project-member] Enqueued Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 652.167356] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 with Priority: HIGHEST for action security_group_rules [ 652.169166] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.169356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.169443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.169735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.169849] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5f0c9b5-5e89-49c6-baa2-5df45e369e48',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.355192] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d911c02-2fb8-4b8a-94ab-e744e4a812ee: rpc.has_security_group_logging(os_id): False [ 652.374436] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.374681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.374681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.374856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.374970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.375212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.375390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.375797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.375797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.375930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.375987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.376171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.376421] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.376545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.376585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.376698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.376774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.376860] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be updated. [ 652.405951] env[65427]: INFO networking_nsxv3.common.synchronization [req-0764a981-7a88-4ddd-baad-503e86d8b2f5 req-c1f75d20-216b-4427-9fa9-f4458abf6766 tempest-ServerAddressesNegativeTestJSON-2092879524 tempest-ServerAddressesNegativeTestJSON-2092879524-project-member] Enqueued Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 652.406789] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGHEST for action security_group_members [ 652.407136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.407260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.407328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.407563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.407715] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.407818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.407889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.408029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.408112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.408209] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.467601] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.467601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.467601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.467601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.467601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.486860] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 652.698590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.698788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.698901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.699173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.699270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.700054] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5f0c9b5-5e89-49c6-baa2-5df45e369e48 already deleted. [ 652.701028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5f0c9b5-5e89-49c6-baa2-5df45e369e48" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.913057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.913057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.913057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.913057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 is going to be updated. [ 652.949938] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.950168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.950168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.952055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.952055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.962943] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: IN_PROGRESS for 2s [ 653.220025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.220025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.220025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.221646] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.724559] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.227238] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.388420] env[65427]: INFO networking_nsxv3.common.synchronization [req-b19f4b3d-283b-44fa-9a8f-f78a27bad225 req-9e617c1f-7b06-49a7-a02c-cac30017c33b tempest-ListImageFiltersTestJSON-1692749154 tempest-ListImageFiltersTestJSON-1692749154-project-member] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 654.388593] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 654.389018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.389163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.389307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.389560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.389725] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.389915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.389963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.390127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.390229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.390368] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.501363] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 654.501668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.730174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.730364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.730410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.730651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.730754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.730850] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be updated. [ 654.761281] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.761442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.761519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.761792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.761946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.769224] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.769405] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.769523] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.769789] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.770187] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.770368] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.770497] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.770810] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.770969] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.771190] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.771292] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.771399] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.771505] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.771614] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.771719] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.771843] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.773610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 654.794633] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.794845] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.795016] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.795218] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.795557] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.795762] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.795884] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.796266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.796365] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f55410d8-6876-4d62-bbb9-68b9fcd24c8d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.892682] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.892889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.893025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.893248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.893347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.893596] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.893708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.893758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.893906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.893988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.894085] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e already deleted. [ 654.894168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.979072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 170e7804-bd59-4b8d-a494-3a73bf406102 in Status: SUCCESS [ 654.979072] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 deletion is rescheduled due to dependency. [ 654.979072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.299188] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.299571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.299571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.299896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.299989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.300158] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port f55410d8-6876-4d62-bbb9-68b9fcd24c8d not found, creating... [ 655.300433] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.300679] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.300808] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.301177] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.301177] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.301469] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.301625] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.301735] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.301939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.302454] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.302732] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: f55410d8-6876-4d62-bbb9-68b9fcd24c8d is going to be created. [ 655.327755] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.328192] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.328484] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.328844] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.329534] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.330011] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.122388] env[65427]: INFO networking_nsxv3.common.synchronization [req-b19f4b3d-283b-44fa-9a8f-f78a27bad225 req-f8aead80-3309-4471-a4d0-85b3c759da2b service nova] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_rules [ 656.122654] env[65427]: INFO networking_nsxv3.common.synchronization [req-b19f4b3d-283b-44fa-9a8f-f78a27bad225 req-f8aead80-3309-4471-a4d0-85b3c759da2b service nova] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 656.122852] env[65427]: INFO networking_nsxv3.common.synchronization [req-b19f4b3d-283b-44fa-9a8f-f78a27bad225 req-f8aead80-3309-4471-a4d0-85b3c759da2b service nova] Enqueued Resource ID: f55410d8-6876-4d62-bbb9-68b9fcd24c8d with Priority: HIGHEST for action port [ 656.123805] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_rules [ 656.124012] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 656.124226] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55410d8-6876-4d62-bbb9-68b9fcd24c8d with Priority: HIGHEST for action port [ 656.124549] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.125206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.125327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.125755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.127257] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.129146] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.129328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.129432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.129697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.129930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.130105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.130204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.130427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.130557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.130694] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.132957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.133307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.133429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.133707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.134731] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f55410d8-6876-4d62-bbb9-68b9fcd24c8d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.636180] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.637906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.638165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.638427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f55410d8-6876-4d62-bbb9-68b9fcd24c8d with status ACTIVE [ 656.638733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.638924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.639055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.639513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.639672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.639984] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.640168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.640281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.640495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.640585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.640846] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.640951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.641022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.641316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.641404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.641491] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f55410d8-6876-4d62-bbb9-68b9fcd24c8d is going to be updated. [ 656.666191] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.666423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.666536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.666882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.667128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.667738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f55410d8-6876-4d62-bbb9-68b9fcd24c8d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.785835] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 656.786492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.786492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.786492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.786686] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.786779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.786842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.787062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.787112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.787958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.787958] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.143988] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.289829] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.290280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.290280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.290786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.291058] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.291212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.291299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.291480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.291776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.291776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.291931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.291931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.292103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.292400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.292400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.292529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.292529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.292673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.292807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.292863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.292971] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.649976] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.650370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.650370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.651137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.651137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.651137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be created. [ 657.678054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.678054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.678054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.678054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.678054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.687841] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: UNINITIALIZED for 2s [ 657.797440] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e055f6e8-5bdf-4d73-ac15-366894643fcc: rpc.has_security_group_logging(os_id): False [ 657.816435] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.816609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.816659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.816875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.816970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.817185] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.817289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.817354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.817539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.817721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.817776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.817844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.817909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.818063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.818139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.818337] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.818431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.818520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.818647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.818717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.818801] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be updated. [ 657.891015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.891180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.891292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.891292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.891613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.905323] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 657.951310] env[65427]: INFO networking_nsxv3.common.synchronization [req-3640a2ec-7338-4ad1-94e8-6638189e6b9c req-c9fc04a8-3b9e-4b7f-9020-7fa40dfba8e9 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 657.952124] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 657.952493] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.952689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.952774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.953017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.953242] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.953410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.953487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.953706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.953807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.953917] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.456926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.457471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457769] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.458094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.458171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.458258] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 658.494246] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.494484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.494589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.494920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.495158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.505997] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 659.384961] env[65427]: INFO networking_nsxv3.common.synchronization [req-1eee6928-ccb3-4d5a-b132-27cda7635771 req-14944844-56de-43f5-81f8-32302b95da47 tempest-ListImageFiltersTestJSON-1692749154 tempest-ListImageFiltersTestJSON-1692749154-project-member] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 659.385824] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 659.386149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.386258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.702795] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 659.702795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.702795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.702795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.702795] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.702795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.702795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.703449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.703449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.703449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.703449] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.705872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.705872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.705872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.705872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.705872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.706180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.706180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.706340] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.710031] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.710215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.711036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.711036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.711036] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.711036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.711318] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.711527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.711949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.711949] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.711949] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.712110] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.712159] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.712239] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.712356] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.712460] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.734018] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.734204] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.734341] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.735305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.735305] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.735305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.735305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.735616] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.735616] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4744abd2-53e8-4e89-bacb-8d42ca43e7ff',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.921027] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 659.921027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.206329] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.206441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.209835] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.238465] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.239018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.239272] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.239622] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.239622] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 4744abd2-53e8-4e89-bacb-8d42ca43e7ff not found, creating... [ 660.239831] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239981] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.240131] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.240363] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.240488] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240822] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.240982] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.241107] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.241340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.241470] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.241675] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 4744abd2-53e8-4e89-bacb-8d42ca43e7ff is going to be created. [ 660.264130] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.264346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.264468] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.264759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.265015] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.265247] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.516464] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 660.516826] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 660.516974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.714905] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.958821] env[65427]: INFO networking_nsxv3.common.synchronization [req-1eee6928-ccb3-4d5a-b132-27cda7635771 req-ae7a2bda-3f4f-4ebc-a6ed-6aa8895554cc service nova] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_rules [ 660.958821] env[65427]: INFO networking_nsxv3.common.synchronization [req-1eee6928-ccb3-4d5a-b132-27cda7635771 req-ae7a2bda-3f4f-4ebc-a6ed-6aa8895554cc service nova] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 660.958953] env[65427]: INFO networking_nsxv3.common.synchronization [req-1eee6928-ccb3-4d5a-b132-27cda7635771 req-ae7a2bda-3f4f-4ebc-a6ed-6aa8895554cc service nova] Enqueued Resource ID: 4744abd2-53e8-4e89-bacb-8d42ca43e7ff with Priority: HIGHEST for action port [ 660.959137] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_rules [ 660.959243] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 660.959336] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4744abd2-53e8-4e89-bacb-8d42ca43e7ff with Priority: HIGHEST for action port [ 660.959869] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.959977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.960531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.960686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.960917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.961068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.961164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.961583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.961837] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4744abd2-53e8-4e89-bacb-8d42ca43e7ff',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.217708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.217887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.217959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.218177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.218263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.218359] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 661.248165] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.248350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.248395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.248721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.249336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.258580] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 661.463889] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4744abd2-53e8-4e89-bacb-8d42ca43e7ff with status ACTIVE [ 661.464508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.464508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.464508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.464706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.465102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.465360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.465481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.465548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.465742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.465828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.466034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.466337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.466406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.466601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.466710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.466825] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4744abd2-53e8-4e89-bacb-8d42ca43e7ff is going to be updated. [ 661.667162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.667162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.667162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.667162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.667162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.667162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4744abd2-53e8-4e89-bacb-8d42ca43e7ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.648632] env[65427]: INFO networking_nsxv3.common.synchronization [req-9d8f9511-3850-40d9-9130-e64314a90e1b req-3b0dfcf5-a6e4-4525-8722-afbfec39f163 tempest-TenantUsagesTestJSON-1463397096 tempest-TenantUsagesTestJSON-1463397096-project-member] Enqueued Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 662.650107] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 662.650664] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.650820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.650900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.651217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.651455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.651455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.651455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.651455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.651455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.651455] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.869561] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f0de8932-0108-4677-ae4f-abc16a2e58a3 None None] Enqueued Resource ID: d68ee7cf-f091-4b90-b028-4baa1d2f1a5e with Priority: HIGHEST for action port [ 662.870177] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d68ee7cf-f091-4b90-b028-4baa1d2f1a5e with Priority: HIGHEST for action port [ 662.871293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d68ee7cf-f091-4b90-b028-4baa1d2f1a5e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.872148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d68ee7cf-f091-4b90-b028-4baa1d2f1a5e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.872148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d68ee7cf-f091-4b90-b028-4baa1d2f1a5e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.872148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d68ee7cf-f091-4b90-b028-4baa1d2f1a5e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.872628] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d68ee7cf-f091-4b90-b028-4baa1d2f1a5e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.145035] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.145035] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.145464] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.145671] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.145943] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.146115] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.146227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.146450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.146569] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.146766] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.146872] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.146975] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.147135] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.147199] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.147287] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.147412] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.155503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.155503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.155503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.155503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.155503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.156571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.156698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.156803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.156992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.157082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.157189] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c already deleted. [ 663.157291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.165549] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.165711] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.165859] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.166018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.166331] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-1abc25d2-81c9-463b-b261-5f35b2588db2 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.166524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.166708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.166934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.167310] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abc25d2-81c9-463b-b261-5f35b2588db2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.268026] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 663.268238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.268341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.268526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.268729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.268873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.268938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.269107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.269192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.269279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.269441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.269529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.269594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.269719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.269861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.269956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.270027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.270168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.270239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.270314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.270412] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.271309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.271476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.271627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.271728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.271784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.271921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.272012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.272096] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.375874] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d68ee7cf-f091-4b90-b028-4baa1d2f1a5e [ 663.376204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.376340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.376412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.376643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.376733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.376832] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d68ee7cf-f091-4b90-b028-4baa1d2f1a5e already deleted. [ 663.376915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d68ee7cf-f091-4b90-b028-4baa1d2f1a5e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.669921] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.670182] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.670300] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.670577] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.670799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.670957] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 1abc25d2-81c9-463b-b261-5f35b2588db2 not found, creating... [ 663.671242] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.671401] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.671516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.671736] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.671870] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.672167] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.672615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.672615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.672615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.672939] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.672939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 1abc25d2-81c9-463b-b261-5f35b2588db2 is going to be created. [ 663.695158] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.695430] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.695583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.695974] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.696224] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.696456] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.774954] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd36953-3031-481f-ae25-8e10517a449e: rpc.has_security_group_logging(os_id): False [ 663.776202] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.805535] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.805768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.805768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.806369] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.806489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.806489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.806904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.807024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.807093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.807210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.807303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.807468] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.807563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.807637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.807753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.807827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.807906] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be created. [ 663.891855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.892386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.892386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.892538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.892870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.908937] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 664.279044] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.401656] env[65427]: INFO networking_nsxv3.common.synchronization [req-9d8f9511-3850-40d9-9130-e64314a90e1b req-282de280-9463-4963-8cb6-ab1cd79dfc8e service nova] Enqueued Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_rules [ 664.401835] env[65427]: INFO networking_nsxv3.common.synchronization [req-9d8f9511-3850-40d9-9130-e64314a90e1b req-282de280-9463-4963-8cb6-ab1cd79dfc8e service nova] Enqueued Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 664.401971] env[65427]: INFO networking_nsxv3.common.synchronization [req-9d8f9511-3850-40d9-9130-e64314a90e1b req-282de280-9463-4963-8cb6-ab1cd79dfc8e service nova] Enqueued Resource ID: 1abc25d2-81c9-463b-b261-5f35b2588db2 with Priority: HIGHEST for action port [ 664.402529] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_rules [ 664.402715] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 664.402874] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1abc25d2-81c9-463b-b261-5f35b2588db2 with Priority: HIGHEST for action port [ 664.403763] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.403763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.403763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.404138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.404138] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.407596] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.407596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.407596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.407596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.407596] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.407596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.408450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.409328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.409328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.409328] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.411366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1abc25d2-81c9-463b-b261-5f35b2588db2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.411366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.411366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.411366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.411366] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abc25d2-81c9-463b-b261-5f35b2588db2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.782170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.782457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.782457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.782918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.782918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.782918] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 664.822999] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.823307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.823307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.823586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.823814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.837077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 664.914868] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.916491] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.916896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.916896] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1abc25d2-81c9-463b-b261-5f35b2588db2 with status ACTIVE [ 664.917150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.917323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.917415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.917720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.918271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.922022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.922022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.922022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.922022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1abc25d2-81c9-463b-b261-5f35b2588db2 is going to be updated. [ 664.946119] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.946420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.946420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.946681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.946855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.947089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1abc25d2-81c9-463b-b261-5f35b2588db2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.044129] env[65427]: INFO networking_nsxv3.common.synchronization [req-5369beaf-f9fd-46f5-acc6-c3f2ca1ea595 req-83b423f9-1a9c-4d68-abee-3183f052cf53 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 665.044501] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 665.045602] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.045772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.045843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.046116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.046292] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.046399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.046496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.046685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.046735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.046827] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.423776] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.442221] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.442842] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.442842] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.443049] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.443333] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.443498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.443622] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.443846] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.444012] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.444263] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.444744] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.444927] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.445082] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.445265] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.445408] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.445639] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.474152] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.474355] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.474555] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.474829] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.475204] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-2b7c9c10-9bc5-4d1d-8401-e51605862143 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.475413] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.475532] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.475875] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.476105] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7c9c10-9bc5-4d1d-8401-e51605862143',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.551370] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.551577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.551756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.551821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.551913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.552456] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.552456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.552456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.552456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.552707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.552707] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f already deleted. [ 665.552707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.920473] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 665.921124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.921375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.921606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.921700] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.927711] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.927860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.927938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.928168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.928274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.928415] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c is going to be created. [ 665.954368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.954620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.954719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.954968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.955175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.966167] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: UNINITIALIZED for 2s [ 665.979220] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.979544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.979620] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.979931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.980100] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.980273] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 2b7c9c10-9bc5-4d1d-8401-e51605862143 not found, creating... [ 665.980555] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.980744] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.980882] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.981170] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.981318] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.981613] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.981801] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.981926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.982170] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.982331] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.982466] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 2b7c9c10-9bc5-4d1d-8401-e51605862143 is going to be created. [ 666.006873] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.007110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.007110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.007373] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.007603] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.007865] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.404848] env[65427]: INFO networking_nsxv3.common.synchronization [None req-cd3f1a01-b2f9-4175-81ba-dada66265c7b None None] Enqueued Resource ID: bef18cc6-be37-46b0-98b3-41e014d5df9c with Priority: HIGHEST for action port [ 666.405715] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef18cc6-be37-46b0-98b3-41e014d5df9c with Priority: HIGHEST for action port [ 666.406213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef18cc6-be37-46b0-98b3-41e014d5df9c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.406213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef18cc6-be37-46b0-98b3-41e014d5df9c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.406510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef18cc6-be37-46b0-98b3-41e014d5df9c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.406831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef18cc6-be37-46b0-98b3-41e014d5df9c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.406927] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef18cc6-be37-46b0-98b3-41e014d5df9c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.424150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.424260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.795236] env[65427]: INFO networking_nsxv3.common.synchronization [req-5369beaf-f9fd-46f5-acc6-c3f2ca1ea595 req-56bdc350-144a-4638-8473-a33d6412e90e service nova] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 666.795703] env[65427]: INFO networking_nsxv3.common.synchronization [req-5369beaf-f9fd-46f5-acc6-c3f2ca1ea595 req-56bdc350-144a-4638-8473-a33d6412e90e service nova] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 666.796749] env[65427]: INFO networking_nsxv3.common.synchronization [req-5369beaf-f9fd-46f5-acc6-c3f2ca1ea595 req-56bdc350-144a-4638-8473-a33d6412e90e service nova] Enqueued Resource ID: 2b7c9c10-9bc5-4d1d-8401-e51605862143 with Priority: HIGHEST for action port [ 666.796865] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_rules [ 666.797310] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 666.797405] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7c9c10-9bc5-4d1d-8401-e51605862143 with Priority: HIGHEST for action port [ 666.797953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.798297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.798297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.798510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.798634] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.800428] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.800556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.800664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.800876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.801070] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.801727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.801727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.801856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.802012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.802161] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.803606] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b7c9c10-9bc5-4d1d-8401-e51605862143 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.803710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.803848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.804057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.804480] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7c9c10-9bc5-4d1d-8401-e51605862143',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.849574] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 666.849912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.850464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.850683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.850880] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.850995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.851068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.851233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.851310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.851394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.851482] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.910217] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bef18cc6-be37-46b0-98b3-41e014d5df9c [ 666.910217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.910217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.910217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.910217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.910217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.910217] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bef18cc6-be37-46b0-98b3-41e014d5df9c already deleted. [ 666.910217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef18cc6-be37-46b0-98b3-41e014d5df9c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.978569] env[65427]: INFO networking_nsxv3.common.synchronization [req-fdc7529f-e402-4f42-b24a-e41dda98decb req-edfa226b-c792-4f31-9d11-18c73f1160df tempest-AttachInterfacesV270Test-458599612 tempest-AttachInterfacesV270Test-458599612-project-member] Enqueued Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 666.978569] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGHEST for action security_group_members [ 666.978569] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.979098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.979098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.979733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.979733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.979733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.979946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.980071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.980250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.980340] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.160623] env[65427]: INFO networking_nsxv3.common.synchronization [req-b69fc7b3-5c3a-40aa-b261-a2f9a99787b9 req-822b23fe-e208-41d4-8d08-b477f2f33521 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 667.161221] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 667.161519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.161638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.161697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.161894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.162089] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.162185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.162244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.162398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.162812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.162812] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.305917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.306135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.306435] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.310039] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b7c9c10-9bc5-4d1d-8401-e51605862143 with status ACTIVE [ 667.310039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.310039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.310039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.310039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.311193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.311193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.311193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b7c9c10-9bc5-4d1d-8401-e51605862143 is going to be updated. [ 667.336226] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.336537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.336537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.337124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.337124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.337124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b7c9c10-9bc5-4d1d-8401-e51605862143" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.355604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.355798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.356103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.356410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.356410] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.356410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.356610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.356644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.356795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.356795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.356950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.357152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.357152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.357311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.357362] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.357576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.357576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.357720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.357779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.357957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.357957] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.483423] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.483423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.483423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.483619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.483619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.483835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.483927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.483995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.484158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.484236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.484654] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 is going to be updated. [ 667.514573] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.514738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.514785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.516025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.516025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.525529] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: IN_PROGRESS for 2s [ 667.667013] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.667254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.667254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.667498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.667794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.667899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.667899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.668066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.668139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.668216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.668348] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 667.700519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.700852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.700852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.701028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.701176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.712624] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 667.814803] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.861745] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd36953-3031-481f-ae25-8e10517a449e: rpc.has_security_group_logging(os_id): False [ 667.883304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.883304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.883304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.883304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.884092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.884289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.884553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.884767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.885067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.885297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.885694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.887836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.887836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.887836] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 667.957967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.957967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.957967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.957967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.957967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.970106] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 667.979326] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: SUCCESS [ 667.979849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.979849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.980049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.980193] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.980323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.980449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.980710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.980825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.980875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.980973] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.318412] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.318587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.318647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.318918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.319030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.319933] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f is going to be created. [ 668.353534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.353673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.353728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.354017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.354122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.366502] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: UNINITIALIZED for 2s [ 668.483447] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.483586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.483586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.483835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.484039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.484191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.484191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.484386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.484495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.484604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.484770] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.484867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.484943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.485142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.485279] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.485460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.485460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.485594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.485654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.485713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.485790] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.991265] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8dbec4d-8461-4cc1-9978-3a0a69ea030c: rpc.has_security_group_logging(os_id): False [ 669.013863] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.015054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.015054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.015054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.015054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.015054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.015054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.016055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.016352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.016457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.016852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.017016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.017059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.017286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.017410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.017709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.017861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.017962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.018192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.018320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.018450] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c is going to be created. [ 669.083439] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.083628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.083729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.083991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.084230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.096715] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: IN_PROGRESS for 2s [ 669.539454] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89734b51-576f-441c-a85a-6861eb7a5b94 in Status: SUCCESS [ 669.539751] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 deletion is rescheduled due to dependency. [ 669.539942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.724722] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 669.724979] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 669.725152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.989290] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 669.991177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.099267] env[65427]: INFO networking_nsxv3.common.synchronization [None req-15bc9131-7859-446f-9340-f3766e31e41f None None] Enqueued Resource ID: 5a28bcf9-6ac3-40d3-9b39-fb904a26cb62 with Priority: HIGHEST for action port [ 670.100261] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a28bcf9-6ac3-40d3-9b39-fb904a26cb62 with Priority: HIGHEST for action port [ 670.100261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a28bcf9-6ac3-40d3-9b39-fb904a26cb62 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.100261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a28bcf9-6ac3-40d3-9b39-fb904a26cb62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.100571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a28bcf9-6ac3-40d3-9b39-fb904a26cb62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.100622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a28bcf9-6ac3-40d3-9b39-fb904a26cb62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.100919] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a28bcf9-6ac3-40d3-9b39-fb904a26cb62',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.376574] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: SUCCESS [ 670.376796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.376973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.377233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.377434] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.377552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.377619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.377774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.377933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.378068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.378166] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.604679] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a28bcf9-6ac3-40d3-9b39-fb904a26cb62 [ 670.604941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.605119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.605197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.605403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.605492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.605588] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a28bcf9-6ac3-40d3-9b39-fb904a26cb62 already deleted. [ 670.605668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a28bcf9-6ac3-40d3-9b39-fb904a26cb62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.880205] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.119714] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: SUCCESS [ 671.120114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.382416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f47490-5211-4c8e-9e0a-b7d44c25960f: rpc.has_security_group_logging(os_id): False [ 671.406184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.406502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.406502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.406691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.406794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.407069] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.408803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.408803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.408803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.408803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.408803] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f is going to be created. [ 671.485394] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.485588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.485693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.485872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.486088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.500992] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: IN_PROGRESS for 2s [ 671.851882] env[65427]: INFO networking_nsxv3.common.synchronization [None req-8c76e624-4387-4c56-b2f9-ab42f57c0561 tempest-ServerActionsV293TestJSON-1237020817 tempest-ServerActionsV293TestJSON-1237020817-project-member] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 671.853592] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 671.853592] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.853592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.853592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.853592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.853592] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.249132] env[65427]: INFO networking_nsxv3.common.synchronization [req-9fa2bfcc-f16f-4f73-992d-056df65e8fab req-a822118d-212f-492d-abe8-db4b03bfa7a7 tempest-ServerPasswordTestJSON-705140258 tempest-ServerPasswordTestJSON-705140258-project-member] Enqueued Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 672.252062] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGHEST for action security_group_members [ 672.252062] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.252062] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.252062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.252062] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.378721] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.378721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.378721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.378721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.378721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.378721] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf already deleted. [ 672.378721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.436922] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b4c822ba-3112-4c2a-8fe3-7a76570c9fa2 tempest-ServerActionsV293TestJSON-1237020817 tempest-ServerActionsV293TestJSON-1237020817-project-member] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 672.437052] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 672.437467] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.439387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.439387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.439387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.439387] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.702282] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-32524c14-463b-4309-b0d6-e789fa643ca0 tempest-ServersTestMultiNic-1560629134 tempest-ServersTestMultiNic-1560629134-project-member] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 672.702282] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 672.704534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.704534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.704534] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.756482] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.757402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.757402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.757402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.757402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.759036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.759180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.759258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.759457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.759542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.759645] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 is going to be updated. [ 672.791848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.792012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.792073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.792295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.792451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.806751] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: IN_PROGRESS for 2s [ 672.965429] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.965429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.965429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.965429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.965429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.965429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf already deleted. [ 672.965429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.983522] env[65427]: INFO networking_nsxv3.common.synchronization [None req-d05f3138-a770-4e90-b85e-d975a1376a4c None None] Enqueued Resource ID: 7232b344-f87e-4e9a-8c88-3c923edc50a1 with Priority: HIGHEST for action port [ 672.985018] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7232b344-f87e-4e9a-8c88-3c923edc50a1 with Priority: HIGHEST for action port [ 672.985018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7232b344-f87e-4e9a-8c88-3c923edc50a1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.985018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7232b344-f87e-4e9a-8c88-3c923edc50a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.985018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7232b344-f87e-4e9a-8c88-3c923edc50a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.985018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7232b344-f87e-4e9a-8c88-3c923edc50a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.985018] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7232b344-f87e-4e9a-8c88-3c923edc50a1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.200956] env[65427]: INFO networking_nsxv3.common.synchronization [req-b226730e-c676-47ff-bf72-43ba53c2a692 req-c0783f6b-15f2-420a-b3bb-531275134ed0 tempest-DeleteServersAdminTestJSON-1806482241 tempest-DeleteServersAdminTestJSON-1806482241-project-member] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 673.200956] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGHEST for action security_group_members [ 673.200956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.201495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.201814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.202367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.202728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.203046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.203366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.203717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.206113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.206113] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.209449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.209449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.209449] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 already deleted. [ 673.209449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.490417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7232b344-f87e-4e9a-8c88-3c923edc50a1 [ 673.490417] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.490417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.490417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.490417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.490417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.490417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7232b344-f87e-4e9a-8c88-3c923edc50a1 already deleted. [ 673.490417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7232b344-f87e-4e9a-8c88-3c923edc50a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.516235] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: SUCCESS [ 673.516235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.530328] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-8e2670c1-e90f-4e44-9c84-c417ce56f136 tempest-ServersTestMultiNic-1560629134 tempest-ServersTestMultiNic-1560629134-project-member] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 673.531056] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 673.531056] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.531056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.531056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.531422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.531422] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.531564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.531564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.531638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.531934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.531934] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.710374] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.710623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.710732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.711094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.711239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.711538] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.711682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.711782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.712030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.712150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.712279] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be updated. [ 673.742493] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.743620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.751599] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: IN_PROGRESS for 2s [ 674.035240] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.035240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.036074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.036074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.036074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.037044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.037044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.037044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.037044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.037434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.037434] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 already deleted. [ 674.037434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.163953] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.164632] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-707" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.164926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-707" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.165530] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-707" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.169467] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.169467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.169467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.169467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.169467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.169467] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.169467] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.169467] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.169467] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.169467] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.169467] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.169467] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.187954] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.188077] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.188764] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.188764] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-707" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.188892] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-ad40069e-a8eb-43e7-b38f-9aefce372dce taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.189207] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.189207] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.189507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.189575] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad40069e-a8eb-43e7-b38f-9aefce372dce',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.695705] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.696077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.696077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.696346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.696506] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.696643] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port ad40069e-a8eb-43e7-b38f-9aefce372dce not found, creating... [ 674.696898] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.697060] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.697171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.697385] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.697516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.697884] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.698160] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.698256] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.698378] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.698506] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.698638] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: ad40069e-a8eb-43e7-b38f-9aefce372dce is going to be created. [ 674.721267] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.721490] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.721607] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.721975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.722138] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.722332] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.818886] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 in Status: SUCCESS [ 674.819107] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 deletion is rescheduled due to dependency. [ 674.819229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.366190] env[65427]: INFO networking_nsxv3.common.synchronization [req-9eb5c7fb-55b0-4fa0-bc8f-5bcfa9cfbb07 req-be54b385-d191-45d4-82fb-21a6c78819c7 tempest-ServersAdminNegativeTestJSON-513132739 tempest-ServersAdminNegativeTestJSON-513132739-project-member] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 675.366897] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 675.368321] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.368321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.368510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.368690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.368925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.369118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.369217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.369429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.369519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.369617] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.432294] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-9833e0ee-6b12-40af-bfdf-d79a04d54489 service nova] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_rules [ 675.432497] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-9833e0ee-6b12-40af-bfdf-d79a04d54489 service nova] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 675.432708] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-9833e0ee-6b12-40af-bfdf-d79a04d54489 service nova] Enqueued Resource ID: ad40069e-a8eb-43e7-b38f-9aefce372dce with Priority: HIGHEST for action port [ 675.433570] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_rules [ 675.433696] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 675.433819] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad40069e-a8eb-43e7-b38f-9aefce372dce with Priority: HIGHEST for action port [ 675.434401] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.434536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.434603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.434861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.434999] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.438378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.438378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.438378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.438378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.438378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.438378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.438378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.439700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.439807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.439911] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.443083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad40069e-a8eb-43e7-b38f-9aefce372dce taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.443083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.443083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.443083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.443083] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad40069e-a8eb-43e7-b38f-9aefce372dce',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.705925] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.706227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.706324] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.706497] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.706764] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.706922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.707051] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.707340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.707519] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.707691] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.707791] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.707909] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.708045] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.708156] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.708258] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.708384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.727913] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.728094] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.728495] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.730068] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.730068] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-10bdb89e-f57e-4550-8eeb-f76f9cadf358 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.730298] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.731217] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.731217] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.731217] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10bdb89e-f57e-4550-8eeb-f76f9cadf358',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.761942] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee in Status: SUCCESS [ 675.762630] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee deletion is rescheduled due to dependency. [ 675.762630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.872042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.872257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.872257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.873054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.873054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.873054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.875201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.875999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.877234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.877448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.877597] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f already deleted. [ 675.877783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad40069e-a8eb-43e7-b38f-9aefce372dce with status ACTIVE [ 675.948020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.948020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.948020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad40069e-a8eb-43e7-b38f-9aefce372dce is going to be updated. [ 675.949806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.950261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.950666] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.974313] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.975218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.975218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.975218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.975218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.975379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad40069e-a8eb-43e7-b38f-9aefce372dce" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.233898] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.233898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.233898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.233898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.233898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.234345] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 10bdb89e-f57e-4550-8eeb-f76f9cadf358 not found, creating... [ 676.234345] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.234442] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.234507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.234717] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.234958] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.235153] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.235448] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.235501] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.235663] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.236058] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.236058] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 10bdb89e-f57e-4550-8eeb-f76f9cadf358 is going to be created. [ 676.256823] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.257055] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.257165] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.257440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.257666] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.257866] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.327321] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.327523] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-424" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.327630] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-424" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.327976] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-424" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.328256] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.328406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.328514] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.328724] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.328861] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.329085] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.329196] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.329294] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.329394] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.329496] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.329595] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.329719] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.358173] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.358353] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.358470] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.358644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-424" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.358959] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-56f36af5-2e9a-4350-acc7-39e896b62eb5 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.359145] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.359254] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.359572] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.359706] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f36af5-2e9a-4350-acc7-39e896b62eb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.454298] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.861961] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.862427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.862427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.862596] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.862742] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.862960] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 56f36af5-2e9a-4350-acc7-39e896b62eb5 not found, creating... [ 676.863243] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.863400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.863510] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.863729] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.863905] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.864244] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.864397] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.864507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.864709] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.864837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.865045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 56f36af5-2e9a-4350-acc7-39e896b62eb5 is going to be created. [ 676.886325] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.886629] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.886629] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.886915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.887170] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.887382] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.949817] env[65427]: INFO networking_nsxv3.common.synchronization [req-9eb5c7fb-55b0-4fa0-bc8f-5bcfa9cfbb07 req-bd94b7b0-42d0-44b9-b5db-467db01490fa service nova] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_rules [ 676.950026] env[65427]: INFO networking_nsxv3.common.synchronization [req-9eb5c7fb-55b0-4fa0-bc8f-5bcfa9cfbb07 req-bd94b7b0-42d0-44b9-b5db-467db01490fa service nova] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 676.950165] env[65427]: INFO networking_nsxv3.common.synchronization [req-9eb5c7fb-55b0-4fa0-bc8f-5bcfa9cfbb07 req-bd94b7b0-42d0-44b9-b5db-467db01490fa service nova] Enqueued Resource ID: 10bdb89e-f57e-4550-8eeb-f76f9cadf358 with Priority: HIGHEST for action port [ 676.950738] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_rules [ 676.950884] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 676.950985] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10bdb89e-f57e-4550-8eeb-f76f9cadf358 with Priority: HIGHEST for action port [ 676.951486] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.951909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.952014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.952328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.952406] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.953381] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.953493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.953564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.953736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.953913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.954045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.954107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.954296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.954367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.954423] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.955329] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-10bdb89e-f57e-4550-8eeb-f76f9cadf358 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.955471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.955471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.955611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.955663] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10bdb89e-f57e-4550-8eeb-f76f9cadf358',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.956969] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.957131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.957131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.957310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.957393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.957481] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be created. [ 676.999782] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.999927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.999927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.000167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.000834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.022570] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: UNINITIALIZED for 2s [ 677.457893] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.458091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.458281] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.463052] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10bdb89e-f57e-4550-8eeb-f76f9cadf358 with status ACTIVE [ 677.463052] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.463052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.463052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.463052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.463052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.463742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.463742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.463742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.463742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.463742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.464113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.464113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.464113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.464288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.464288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.464288] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10bdb89e-f57e-4550-8eeb-f76f9cadf358 is going to be updated. [ 677.498613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.498613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.498613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.498842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.499014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.499265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10bdb89e-f57e-4550-8eeb-f76f9cadf358" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.646575] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-d1f007f6-cb4d-40ba-9507-699ffe9bcdcc service nova] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_rules [ 677.646836] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-d1f007f6-cb4d-40ba-9507-699ffe9bcdcc service nova] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 677.647011] env[65427]: INFO networking_nsxv3.common.synchronization [req-edf55ff3-ed1f-4f86-9a81-8ff29b5837f4 req-d1f007f6-cb4d-40ba-9507-699ffe9bcdcc service nova] Enqueued Resource ID: 56f36af5-2e9a-4350-acc7-39e896b62eb5 with Priority: HIGHEST for action port [ 677.647690] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_rules [ 677.647862] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 677.648010] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56f36af5-2e9a-4350-acc7-39e896b62eb5 with Priority: HIGHEST for action port [ 677.649449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.649596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.649911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.650061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.650329] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-56f36af5-2e9a-4350-acc7-39e896b62eb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.650476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.650564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.654249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.654373] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f36af5-2e9a-4350-acc7-39e896b62eb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.961274] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.158384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56f36af5-2e9a-4350-acc7-39e896b62eb5 with status ACTIVE [ 678.158384] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.158384] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.158384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.158769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.158769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.158842] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.158951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.159038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.159195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.159291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.159904] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56f36af5-2e9a-4350-acc7-39e896b62eb5 is going to be updated. [ 678.188368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.188509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.188559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.189152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.189152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.189152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56f36af5-2e9a-4350-acc7-39e896b62eb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.464120] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.464342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.464342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.466420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.466420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.466420] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be created. [ 678.489866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.489866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.489866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.489866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.490127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.502273] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: UNINITIALIZED for 2s [ 679.034664] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 679.034963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.035171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.035463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.035676] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.035797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.035864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.036479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.036479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.036479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.036479] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.037294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.037456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.037729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.037729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.037729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.040610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.040610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.040610] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.543953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.543953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.543953] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.924227] env[65427]: INFO networking_nsxv3.common.synchronization [req-280106ea-8aeb-4638-a574-83079f5e1bfe req-2fefd4c1-437e-4894-913b-9e446a84b3c0 tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 679.924816] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 679.927027] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.927027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.927027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.927233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.927454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.927608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.927687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.927862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.927951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.928063] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.046242] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.430817] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.513907] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 680.514251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.514499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.514822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.515035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.515158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.515228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.515471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.515607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.515746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.515901] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.548301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.548467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.548653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.548881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.548970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.549084] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be updated. [ 680.579879] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.580163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.580163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.580337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.580463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.590191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: IN_PROGRESS for 2s [ 680.650208] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.650436] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.650558] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.650863] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.651363] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.651529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.651644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.651872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.652036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.652245] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.652351] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.652455] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.652562] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.652659] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.652759] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.652974] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.673130] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.673446] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.673557] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.674529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.674529] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-71d5a225-31f9-45e4-92a7-588bca0a8115 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.674529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.674817] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.674942] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.675087] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d5a225-31f9-45e4-92a7-588bca0a8115',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.933317] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.017843] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.017936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.018015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.018252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.018482] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.018637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.018750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.018978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.019155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.019283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.019504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.019753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.019753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.019961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.020186] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.020342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.020401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.021307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.021307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.021307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.021307] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.177847] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.178425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.178425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.178725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.178930] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.179152] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 71d5a225-31f9-45e4-92a7-588bca0a8115 not found, creating... [ 681.179525] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.179746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.180119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.180574] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.180717] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.181252] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.181518] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.181717] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.182070] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.182311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.182465] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 71d5a225-31f9-45e4-92a7-588bca0a8115 is going to be created. [ 681.204307] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.204548] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.204686] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.204897] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.205380] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.205434] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.438171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.438171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.438171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.438171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.438171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.438171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 681.486758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.486758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.486758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.487040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.488031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.498082] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 681.527650] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 584eb45a-7106-4759-8924-ff61fcdd399f: rpc.has_security_group_logging(os_id): False [ 681.547550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.547767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.547767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.548109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.548109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.548256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.548361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.548426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.548631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.548758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.549087] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.549303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.550162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.550162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.550162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.550162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.550162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.550423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.550423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.550503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.550542] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be created. [ 681.635444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.635550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.635632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.635832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.636058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.647982] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 681.736387] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3d6e1d9c-380e-4d64-8dc8-e97209541a45 None None] Enqueued Resource ID: 826468af-ee80-413a-b0c2-b80ce89714bf with Priority: HIGHEST for action port [ 681.736965] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826468af-ee80-413a-b0c2-b80ce89714bf with Priority: HIGHEST for action port [ 681.737305] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-826468af-ee80-413a-b0c2-b80ce89714bf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.737431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-826468af-ee80-413a-b0c2-b80ce89714bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.737509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-826468af-ee80-413a-b0c2-b80ce89714bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.737787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-826468af-ee80-413a-b0c2-b80ce89714bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.737889] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826468af-ee80-413a-b0c2-b80ce89714bf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.968412] env[65427]: INFO networking_nsxv3.common.synchronization [req-280106ea-8aeb-4638-a574-83079f5e1bfe req-bc5dde94-497c-463b-8c8f-65b16be76de8 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 681.968634] env[65427]: INFO networking_nsxv3.common.synchronization [req-280106ea-8aeb-4638-a574-83079f5e1bfe req-bc5dde94-497c-463b-8c8f-65b16be76de8 service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 681.968727] env[65427]: INFO networking_nsxv3.common.synchronization [req-280106ea-8aeb-4638-a574-83079f5e1bfe req-bc5dde94-497c-463b-8c8f-65b16be76de8 service nova] Enqueued Resource ID: 71d5a225-31f9-45e4-92a7-588bca0a8115 with Priority: HIGHEST for action port [ 681.969306] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 681.969446] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 681.969570] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d5a225-31f9-45e4-92a7-588bca0a8115 with Priority: HIGHEST for action port [ 681.971417] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.971417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.971417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.971417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.971417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.971894] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.971894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.972586] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d5a225-31f9-45e4-92a7-588bca0a8115 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.972586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.972586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.972586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.972586] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d5a225-31f9-45e4-92a7-588bca0a8115',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.246692] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 826468af-ee80-413a-b0c2-b80ce89714bf [ 682.246692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.246692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.246692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.246692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.246692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.246692] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:826468af-ee80-413a-b0c2-b80ce89714bf already deleted. [ 682.247244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-826468af-ee80-413a-b0c2-b80ce89714bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.476408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.476567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.476770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71d5a225-31f9-45e4-92a7-588bca0a8115 with status ACTIVE [ 682.476974] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.477203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.477268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.477462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.477677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.477832] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.477937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.477937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.478294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.478294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.478439] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.478526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.478526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.478639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.478733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.478835] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71d5a225-31f9-45e4-92a7-588bca0a8115 is going to be updated. [ 682.507921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.509120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.509120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.509120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.509120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.509120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d5a225-31f9-45e4-92a7-588bca0a8115" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.603713] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 682.603971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.604179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.604819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.605185] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.605462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.605462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.605881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.605881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.605881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.605881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.606822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.606905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.607101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.607289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.607422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.607516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.607884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.607976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.608076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.608170] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.825850] env[65427]: INFO networking_nsxv3.common.synchronization [req-a78f7187-1a79-4b42-91a0-fa7f81d417a9 req-fc9ffa4f-e369-45eb-9f18-d41ea4a2108b tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 682.826462] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 682.827282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.827282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.827282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.827282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.827282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.827581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.827581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.827657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.827837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.827837] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.112209] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edd2e5f2-2b98-4da6-a58d-0f7cac660a06: rpc.has_security_group_logging(os_id): False [ 683.132242] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.132388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.133224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.133224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.133224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.133385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.133514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.133566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.133828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.134091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.134288] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.134433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.134485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.134627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.134681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.134904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.134980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.135046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.135213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.135300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.135395] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be created. [ 683.211510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.211510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.211660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.211939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.211939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.229440] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: IN_PROGRESS for 2s [ 683.330659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.330659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.330659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.330999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.330999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.331129] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.331235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.331308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.331512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.331599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.331690] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 683.367928] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.367928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.367928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.368260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.368260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.383072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 683.512735] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 683.513047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.513231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.513463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.513651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.513773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.513837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.514034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.514125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.514222] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.661576] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 683.661576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.669194] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.669194] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.669194] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.669194] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.669477] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.669543] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.669637] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.669859] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.669999] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.670241] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.670330] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.670419] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.670519] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.670623] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.670770] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.670937] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.689331] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.689497] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.689644] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.689815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.690183] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-05077b49-d73d-4a04-ac35-330726eb8399 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.690364] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.690473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.690817] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.691023] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05077b49-d73d-4a04-ac35-330726eb8399',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.972479] env[65427]: INFO networking_nsxv3.common.synchronization [None req-47b29a69-fd67-4e8f-8009-0861f96403a3 None None] Enqueued Resource ID: 5b1b8a3d-6fe3-41d5-8534-5601ce71675d with Priority: HIGHEST for action port [ 683.972479] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1b8a3d-6fe3-41d5-8534-5601ce71675d with Priority: HIGHEST for action port [ 683.972815] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b1b8a3d-6fe3-41d5-8534-5601ce71675d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.972973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b1b8a3d-6fe3-41d5-8534-5601ce71675d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.973090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b1b8a3d-6fe3-41d5-8534-5601ce71675d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.973515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b1b8a3d-6fe3-41d5-8534-5601ce71675d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.973515] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b1b8a3d-6fe3-41d5-8534-5601ce71675d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.016825] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.023974] env[65427]: INFO networking_nsxv3.common.synchronization [req-d049b660-6b6b-4b34-9819-1532c2389f5d req-8646e50f-ac8a-4f95-b9bb-274dc4ca9b23 tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 684.024627] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 684.024885] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.025022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.025212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.025293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.025441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.025550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.025649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.025738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.025822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.026258] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.193922] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.194192] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.194320] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.195173] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.195173] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.195173] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 05077b49-d73d-4a04-ac35-330726eb8399 not found, creating... [ 684.195173] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.195545] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.195545] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.195674] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.195739] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.195999] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.196200] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.196318] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.196517] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.196646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.196777] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 05077b49-d73d-4a04-ac35-330726eb8399 is going to be created. [ 684.221795] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.222040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.222180] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.222448] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.222689] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.222949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.475684] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b1b8a3d-6fe3-41d5-8534-5601ce71675d [ 684.475684] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.475684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.476132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.476132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.476207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.476471] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b1b8a3d-6fe3-41d5-8534-5601ce71675d already deleted. [ 684.476471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b1b8a3d-6fe3-41d5-8534-5601ce71675d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.518637] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.529096] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.529096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.529096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.529096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.529096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.529448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.529448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.529542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.529715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.529815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.529930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 684.563601] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.563860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.563976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.564262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.564422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.575357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 685.024066] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.024344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.024510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.024841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.025034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.025516] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 685.033017] env[65427]: INFO networking_nsxv3.common.synchronization [req-a78f7187-1a79-4b42-91a0-fa7f81d417a9 req-0b62515c-a7a0-4b21-8578-80b95de9ceea service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 685.033017] env[65427]: INFO networking_nsxv3.common.synchronization [req-a78f7187-1a79-4b42-91a0-fa7f81d417a9 req-0b62515c-a7a0-4b21-8578-80b95de9ceea service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 685.033166] env[65427]: INFO networking_nsxv3.common.synchronization [req-a78f7187-1a79-4b42-91a0-fa7f81d417a9 req-0b62515c-a7a0-4b21-8578-80b95de9ceea service nova] Enqueued Resource ID: 05077b49-d73d-4a04-ac35-330726eb8399 with Priority: HIGHEST for action port [ 685.034089] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 685.035044] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 685.035044] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05077b49-d73d-4a04-ac35-330726eb8399 with Priority: HIGHEST for action port [ 685.035576] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.035783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.036409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.036409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.036591] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.037941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.038176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.038561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-05077b49-d73d-4a04-ac35-330726eb8399 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.038785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.039038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.039364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.039562] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05077b49-d73d-4a04-ac35-330726eb8399',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.071936] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.073304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.073304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.073304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.073304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.087412] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 685.241859] env[65427]: INFO networking_nsxv3.common.synchronization [None req-774385f5-0b5d-4868-9a4b-97fd766a85de None None] Enqueued Resource ID: 7c592a0a-f2d9-462e-bd72-18f882fb4f90 with Priority: HIGHEST for action port [ 685.242890] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c592a0a-f2d9-462e-bd72-18f882fb4f90 with Priority: HIGHEST for action port [ 685.243201] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c592a0a-f2d9-462e-bd72-18f882fb4f90 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.243341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c592a0a-f2d9-462e-bd72-18f882fb4f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.243555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c592a0a-f2d9-462e-bd72-18f882fb4f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.243664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c592a0a-f2d9-462e-bd72-18f882fb4f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.243743] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c592a0a-f2d9-462e-bd72-18f882fb4f90',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.252729] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 685.253390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.253390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.253390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.254333] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.397673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 685.400092] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 685.400092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.400092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.400092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.400092] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.400092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.400092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.400928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.401582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.401582] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.542266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.542592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.542686] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05077b49-d73d-4a04-ac35-330726eb8399 with status ACTIVE [ 685.542927] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.542996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.544355] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.544355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.544355] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.544853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.544853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.544853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.544853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.545108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05077b49-d73d-4a04-ac35-330726eb8399 is going to be updated. [ 685.570013] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.570252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.570252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.570457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.570596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.570758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05077b49-d73d-4a04-ac35-330726eb8399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.746508] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c592a0a-f2d9-462e-bd72-18f882fb4f90 [ 685.747022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.747307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.747307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.747517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.747572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.747629] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c592a0a-f2d9-462e-bd72-18f882fb4f90 already deleted. [ 685.747712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c592a0a-f2d9-462e-bd72-18f882fb4f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.757311] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.757508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.757592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.757822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.758017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.758141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.758203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.758393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.758488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.758589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.758708] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.904555] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.261526] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.261705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.261762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.262067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.262410] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.262410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.262575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.262647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.262730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.262817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.263015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.263109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.263172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.263412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.263474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.263525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.263589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.263720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.263796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.263874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.263966] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.409589] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.586611] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 686.587374] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f deletion is rescheduled due to dependency. [ 686.587508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.767814] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edd2e5f2-2b98-4da6-a58d-0f7cac660a06: rpc.has_security_group_logging(os_id): False [ 686.785047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.785294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.785379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.785603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.785696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.785923] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.786018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.786047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.786199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.786275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.786456] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.786549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.786610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.786746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.786820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.789046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.789046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.789046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.789046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.789046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.789046] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be updated. [ 686.858018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.858018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.858018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.858018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.858018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.879156] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: IN_PROGRESS for 2s [ 686.918314] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.918314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.918314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.918314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.918314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.918314] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 686.981534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.981534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.981534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.981534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.981534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.998996] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 687.104067] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 687.105162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.107750] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.107750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.107750] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.609692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.610122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.610122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.610203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.610346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.610442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.610505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.610661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.610734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.610832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.611054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.611155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.611219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.611380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.611497] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.611590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.611653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.611790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.611866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.611948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.612053] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.783314] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9c530849-e8ee-47fe-8794-a19a0b86b40a None None] Enqueued Resource ID: a7b3ca14-ea5e-46cf-bf86-02ef9e49c105 with Priority: HIGHEST for action port [ 687.783849] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b3ca14-ea5e-46cf-bf86-02ef9e49c105 with Priority: HIGHEST for action port [ 687.784182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b3ca14-ea5e-46cf-bf86-02ef9e49c105 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.784306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b3ca14-ea5e-46cf-bf86-02ef9e49c105" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.784373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b3ca14-ea5e-46cf-bf86-02ef9e49c105" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.784622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b3ca14-ea5e-46cf-bf86-02ef9e49c105" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.784705] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b3ca14-ea5e-46cf-bf86-02ef9e49c105',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.895684] env[65427]: INFO networking_nsxv3.common.synchronization [None req-fd58c4ea-3fcd-4853-8538-9205860444a8 None None] Enqueued Resource ID: fad5aa6c-0d0e-4448-80ee-510a83cb8b7f with Priority: HIGHEST for action port [ 687.896278] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fad5aa6c-0d0e-4448-80ee-510a83cb8b7f with Priority: HIGHEST for action port [ 687.896597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-fad5aa6c-0d0e-4448-80ee-510a83cb8b7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.896716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fad5aa6c-0d0e-4448-80ee-510a83cb8b7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.896785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fad5aa6c-0d0e-4448-80ee-510a83cb8b7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.897064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fad5aa6c-0d0e-4448-80ee-510a83cb8b7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.897155] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fad5aa6c-0d0e-4448-80ee-510a83cb8b7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.115794] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5de73072-1420-4348-9a8f-7aea1d3f3f89: rpc.has_security_group_logging(os_id): False [ 688.135016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.135224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.135320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.135521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.135653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.135898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.136053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.137742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.137742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.137742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.137742] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 688.202925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.203104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.203175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.203384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.203526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.221927] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 688.286536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b3ca14-ea5e-46cf-bf86-02ef9e49c105 [ 688.286774] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.286902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.286965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.287804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.287804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.287804] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b3ca14-ea5e-46cf-bf86-02ef9e49c105 already deleted. [ 688.287804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b3ca14-ea5e-46cf-bf86-02ef9e49c105" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.399394] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fad5aa6c-0d0e-4448-80ee-510a83cb8b7f [ 688.399682] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.399779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.399817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.401948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.401948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.401948] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fad5aa6c-0d0e-4448-80ee-510a83cb8b7f already deleted. [ 688.401948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fad5aa6c-0d0e-4448-80ee-510a83cb8b7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.418742] env[65427]: INFO networking_nsxv3.common.synchronization [None req-cfc785f3-b63b-4f84-960d-09c6877c107a None None] Enqueued Resource ID: 689750e6-8491-420d-b451-78e739ef0da0 with Priority: HIGHEST for action port [ 688.418742] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689750e6-8491-420d-b451-78e739ef0da0 with Priority: HIGHEST for action port [ 688.419077] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-689750e6-8491-420d-b451-78e739ef0da0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.419245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-689750e6-8491-420d-b451-78e739ef0da0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.419245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-689750e6-8491-420d-b451-78e739ef0da0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.419501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-689750e6-8491-420d-b451-78e739ef0da0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.419577] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689750e6-8491-420d-b451-78e739ef0da0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.896372] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 688.900745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.924600] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 689750e6-8491-420d-b451-78e739ef0da0 [ 688.926443] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.926443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.926443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.926443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.926443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.926443] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:689750e6-8491-420d-b451-78e739ef0da0 already deleted. [ 688.926443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-689750e6-8491-420d-b451-78e739ef0da0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.016627] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 689.016627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.016780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.016929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.017151] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.017567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.017567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.017567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.017567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.017697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.017727] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.520806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.520806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.520806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.521080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.521474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.521474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.521474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.521608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.521608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.521657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.521864] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.522023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.522130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.522292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.522503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.523045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.523045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.523045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.523716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.523955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.524142] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.027162] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7abbe624-4b85-4277-bdd0-ed749e166fc9: rpc.has_security_group_logging(os_id): False [ 690.049564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.049564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.049564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.049564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.049788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.049961] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.050016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.050303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.050303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.050379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.052884] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.052884] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.052884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.052884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 690.319477] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 690.319711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.338538] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.338717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.338819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.339096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.339257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.386211] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 691.621975] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3f9e0dc3-ddf6-4643-b318-c5567d599456 None None] Enqueued Resource ID: 95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1 with Priority: HIGHEST for action port [ 691.623511] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1 with Priority: HIGHEST for action port [ 691.623511] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.623511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.623718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.623824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.623907] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.126442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1 [ 692.126866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.127137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.127290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.127594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.127974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.127974] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1 already deleted. [ 692.128074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b9cfdb-01a9-4c08-9ff8-8c2c92a61be1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.407262] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 692.407548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.828365] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a85339d4-b2ba-4690-8601-60e546f285f2 tempest-ServersTestManualDisk-660276821 tempest-ServersTestManualDisk-660276821-project-member] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 692.831868] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 692.832327] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.832481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.832567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.832870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.833070] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.886707] env[65427]: INFO networking_nsxv3.common.synchronization [req-eebb8e94-9dad-4c88-bb00-f0987057bbd2 req-f7854188-47b4-4957-b29d-a9e1ffb2dcb4 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 692.887290] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 692.887581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.887706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.887775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.889685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.889685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.889685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.889685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.889885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.889971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.890104] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.261270] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3d81ccba-b2f1-463e-8166-838c4c2c8bc8 tempest-ServersTestManualDisk-660276821 tempest-ServersTestManualDisk-660276821-project-member] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 693.261853] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 693.262213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.262349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.358554] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.358901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.359011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.359324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.359485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.359623] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e already deleted. [ 693.359821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.359990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.360248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.360389] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.395088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.395453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.395559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.395817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.395973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.396162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.396268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.396363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.396569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.396668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.396777] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b already deleted. [ 693.396895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.566714] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.566953] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.567075] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.567591] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.567718] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.567885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.568018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.569273] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.569273] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.569565] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.569794] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.571459] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.571459] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.571459] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.571459] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.571459] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.583083] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f2230d3a-1eb4-42d4-b092-328f9df20f19 None None] Enqueued Resource ID: 325f1423-b43f-4e6e-be8d-da00eecd1140 with Priority: HIGHEST for action port [ 693.583662] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 325f1423-b43f-4e6e-be8d-da00eecd1140 with Priority: HIGHEST for action port [ 693.584017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-325f1423-b43f-4e6e-be8d-da00eecd1140 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.584188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-325f1423-b43f-4e6e-be8d-da00eecd1140" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.584496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-325f1423-b43f-4e6e-be8d-da00eecd1140" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.584561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-325f1423-b43f-4e6e-be8d-da00eecd1140" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.584603] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325f1423-b43f-4e6e-be8d-da00eecd1140',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.594246] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.594246] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.594246] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.594361] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.594708] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-22978b46-1e56-47d6-a8fd-00073faaadc0 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.594896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.596173] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.596566] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.596733] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22978b46-1e56-47d6-a8fd-00073faaadc0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.886439] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.886751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.886751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.886866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.886974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.887075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e already deleted. [ 693.887163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.087749] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 325f1423-b43f-4e6e-be8d-da00eecd1140 [ 694.087749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.087938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.087938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.088219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.088329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.088435] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:325f1423-b43f-4e6e-be8d-da00eecd1140 already deleted. [ 694.088560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-325f1423-b43f-4e6e-be8d-da00eecd1140" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.100536] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.100932] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.101141] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.102029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.102195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.102459] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 22978b46-1e56-47d6-a8fd-00073faaadc0 not found, creating... [ 694.102837] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.103301] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.104083] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.104083] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.104083] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.104333] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.104421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.104540] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.104787] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.104936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.105108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 22978b46-1e56-47d6-a8fd-00073faaadc0 is going to be created. [ 694.135985] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.136834] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.136834] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.137291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.137724] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.138506] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.605508] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c99bdea6-f843-48f8-868e-93a3124cc446 None None] Enqueued Resource ID: 99cf23dd-a23a-42b9-889d-2ab1d223c984 with Priority: HIGHEST for action port [ 694.605811] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99cf23dd-a23a-42b9-889d-2ab1d223c984 with Priority: HIGHEST for action port [ 694.606186] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-99cf23dd-a23a-42b9-889d-2ab1d223c984 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.606339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99cf23dd-a23a-42b9-889d-2ab1d223c984" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.606422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99cf23dd-a23a-42b9-889d-2ab1d223c984" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.606712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99cf23dd-a23a-42b9-889d-2ab1d223c984" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.607337] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99cf23dd-a23a-42b9-889d-2ab1d223c984',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.915797] env[65427]: INFO networking_nsxv3.common.synchronization [req-eebb8e94-9dad-4c88-bb00-f0987057bbd2 req-6f4e1b9b-993b-4fb8-b7a9-a1491a824a26 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 694.916142] env[65427]: INFO networking_nsxv3.common.synchronization [req-eebb8e94-9dad-4c88-bb00-f0987057bbd2 req-6f4e1b9b-993b-4fb8-b7a9-a1491a824a26 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 694.916142] env[65427]: INFO networking_nsxv3.common.synchronization [req-eebb8e94-9dad-4c88-bb00-f0987057bbd2 req-6f4e1b9b-993b-4fb8-b7a9-a1491a824a26 service nova] Enqueued Resource ID: 22978b46-1e56-47d6-a8fd-00073faaadc0 with Priority: HIGHEST for action port [ 694.916700] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 694.920297] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 694.920409] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22978b46-1e56-47d6-a8fd-00073faaadc0 with Priority: HIGHEST for action port [ 694.920746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.921045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.922675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.925437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.925437] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.925437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.925437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.925437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.925766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.925766] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.925845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.925875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.926049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.926097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.928985] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.930053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-22978b46-1e56-47d6-a8fd-00073faaadc0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.930053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.930053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.930053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.930053] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22978b46-1e56-47d6-a8fd-00073faaadc0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.110070] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99cf23dd-a23a-42b9-889d-2ab1d223c984 [ 695.114350] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.114350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.114350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.114350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.114350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.114350] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99cf23dd-a23a-42b9-889d-2ab1d223c984 already deleted. [ 695.114350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99cf23dd-a23a-42b9-889d-2ab1d223c984" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.261275] env[65427]: INFO networking_nsxv3.common.synchronization [req-a7bd455f-13e4-4bd1-a0ab-d10678ab01b4 req-e42c1f99-23d7-4857-aa97-24500005e520 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 695.261275] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 695.261439] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.261597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.261740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.261903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.263613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.263736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.263771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.264493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.264715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.264851] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.432495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.432495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.432694] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.570761] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f622c6a0-6f73-4050-b4af-29e7a8a80e3a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 695.570761] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 695.571383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.571383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.571383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.571701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.571794] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.732591] env[65427]: INFO networking_nsxv3.common.synchronization [None req-d1734dde-463f-4a9e-b508-5cf618375bf8 tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 695.733436] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 695.733831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.733889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.768356] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.768547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.768577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.768804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.769512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.769512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.769512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.769512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.769512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.769731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.769731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 695.774508] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.775227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.775227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.775227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.775988] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.780234] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.780317] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.780600] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.780750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.780970] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.781090] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.781196] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.781296] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.781398] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.781496] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.781628] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.802300] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.802387] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.802758] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.803715] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.803715] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-a5ced2a1-e716-4edf-81d2-269c02cb6c62 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.803715] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.803926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.804232] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.804418] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5ced2a1-e716-4edf-81d2-269c02cb6c62',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.816137] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.816554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.816554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.816725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.816861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.833402] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 695.936693] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.937663] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22978b46-1e56-47d6-a8fd-00073faaadc0 with status ACTIVE [ 695.937896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.938738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.939732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.939732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.939732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.939857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.942096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.942211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.942437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.942542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.942841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.943043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.943125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.943363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.943469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.943571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22978b46-1e56-47d6-a8fd-00073faaadc0 is going to be updated. [ 695.974213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.974213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.974213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.974394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.974743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.974743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22978b46-1e56-47d6-a8fd-00073faaadc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.102315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.102315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.102692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.102692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.102796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.102840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f already deleted. [ 696.103237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.103237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.103441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.103441] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.309337] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.309545] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.309672] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.309915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.310085] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.310256] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port a5ced2a1-e716-4edf-81d2-269c02cb6c62 not found, creating... [ 696.310539] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.310724] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.310843] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.311203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.311330] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.311555] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.311703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.311867] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.312699] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.312880] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.314771] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: a5ced2a1-e716-4edf-81d2-269c02cb6c62 is going to be created. [ 696.344624] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.344933] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.345082] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.345528] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.345827] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.346158] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.408550] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b9e2383a-c254-42f7-a6d1-e9fab858e63e None None] Enqueued Resource ID: a3f3acc5-ae21-466c-ab0a-e08b0a97578c with Priority: HIGHEST for action port [ 696.409323] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f3acc5-ae21-466c-ab0a-e08b0a97578c with Priority: HIGHEST for action port [ 696.409642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3f3acc5-ae21-466c-ab0a-e08b0a97578c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.409776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3f3acc5-ae21-466c-ab0a-e08b0a97578c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.409867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3f3acc5-ae21-466c-ab0a-e08b0a97578c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.410117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3f3acc5-ae21-466c-ab0a-e08b0a97578c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.410203] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3f3acc5-ae21-466c-ab0a-e08b0a97578c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.447633] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.447794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.447856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.448074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.448177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.448309] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be created. [ 696.476773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.477097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.477097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.477307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.477488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.500297] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: UNINITIALIZED for 2s [ 696.624873] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.624873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.625349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.625693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.626035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.626323] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f already deleted. [ 696.626528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.913903] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3f3acc5-ae21-466c-ab0a-e08b0a97578c [ 696.913903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.914121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.914174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.914930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.914930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.915997] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3f3acc5-ae21-466c-ab0a-e08b0a97578c already deleted. [ 696.915997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3f3acc5-ae21-466c-ab0a-e08b0a97578c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.204866] env[65427]: INFO networking_nsxv3.common.synchronization [None req-1ac629ea-d2c9-4fb3-b8c2-7d4cffc2bb68 None None] Enqueued Resource ID: be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b with Priority: HIGHEST for action port [ 697.205556] env[65427]: INFO networking_nsxv3.common.synchronization [req-a7bd455f-13e4-4bd1-a0ab-d10678ab01b4 req-80c4bed5-0a63-452e-8e96-fdc809042a09 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 697.206103] env[65427]: INFO networking_nsxv3.common.synchronization [req-a7bd455f-13e4-4bd1-a0ab-d10678ab01b4 req-80c4bed5-0a63-452e-8e96-fdc809042a09 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 697.206103] env[65427]: INFO networking_nsxv3.common.synchronization [req-a7bd455f-13e4-4bd1-a0ab-d10678ab01b4 req-80c4bed5-0a63-452e-8e96-fdc809042a09 service nova] Enqueued Resource ID: a5ced2a1-e716-4edf-81d2-269c02cb6c62 with Priority: HIGHEST for action port [ 697.206493] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b with Priority: HIGHEST for action port [ 697.206663] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 697.206708] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 697.206778] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5ced2a1-e716-4edf-81d2-269c02cb6c62 with Priority: HIGHEST for action port [ 697.207100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.207228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.207293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.207545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.207655] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.209408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.209408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.209408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.209408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.209408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.209600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.209774] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.210542] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5ced2a1-e716-4edf-81d2-269c02cb6c62 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.210951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.210951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.210951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.210951] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5ced2a1-e716-4edf-81d2-269c02cb6c62',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.712739] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b [ 697.713090] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.713245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.713343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.713615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.713735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.713861] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b already deleted. [ 697.714026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be1dec2b-5fa3-4d4d-8afa-cb4d56aecf6b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.714605] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.714741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.714938] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5ced2a1-e716-4edf-81d2-269c02cb6c62 with status ACTIVE [ 697.715151] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.715281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.715352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.715553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.715639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.715838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.715959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.717491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.717803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.717849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.718107] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.718217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.718281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.718461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.718547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.718635] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5ced2a1-e716-4edf-81d2-269c02cb6c62 is going to be updated. [ 697.744044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.745036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.745036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.745036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.745036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.745036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5ced2a1-e716-4edf-81d2-269c02cb6c62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.849413] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 697.849413] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.849413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.849413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.850105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.850726] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.355108] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.514562] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 698.514913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.515126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.515480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.515786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.515950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.516079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.516259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.516328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.516399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.516493] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.542064] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9fa1fac-97e4-476e-aac4-a16d126e079d req-5dadbf5c-46f9-4418-bbd3-148e890bdfdc tempest-FloatingIPsAssociationTestJSON-904560228 tempest-FloatingIPsAssociationTestJSON-904560228-project-member] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 698.542843] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 698.543429] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.543647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.543647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.543779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.543944] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.544658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.544840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.545088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.546507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.546638] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.857351] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.021074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.021074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.021074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.021074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.021074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.021074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.021074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.021513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.021513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.021513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.021660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.021722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.021817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.022093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.025793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.026447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.026447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.026559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.026609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.026825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.026825] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.049745] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.362245] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.362670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.362732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.363169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.363348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.363541] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 699.378160] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b1a4e6cf-658f-42be-bfb2-9d8a70580197 None None] Enqueued Resource ID: 4e494da7-60d2-41a2-a5b1-466b2a2c55a0 with Priority: HIGHEST for action port [ 699.378891] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e494da7-60d2-41a2-a5b1-466b2a2c55a0 with Priority: HIGHEST for action port [ 699.385786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e494da7-60d2-41a2-a5b1-466b2a2c55a0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.387314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e494da7-60d2-41a2-a5b1-466b2a2c55a0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.387314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e494da7-60d2-41a2-a5b1-466b2a2c55a0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.387314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e494da7-60d2-41a2-a5b1-466b2a2c55a0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.387314] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e494da7-60d2-41a2-a5b1-466b2a2c55a0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.403256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.403436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.403472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.403688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.403837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.418210] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 699.531194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 699.556956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.558704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.558704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.558704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.558704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.558704] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.559465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.559465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.559465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.559465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.559756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.559756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.559756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.560040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.560340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.560550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.560674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.560749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.560921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.561013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.561102] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be created. [ 699.562458] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.645319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.645509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.645660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.661899] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 699.895024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e494da7-60d2-41a2-a5b1-466b2a2c55a0 [ 699.895024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.895024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.895024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.895024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.895024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.895024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e494da7-60d2-41a2-a5b1-466b2a2c55a0 already deleted. [ 699.895024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e494da7-60d2-41a2-a5b1-466b2a2c55a0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.064733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.066079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.066334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.066618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.066741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.066882] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be updated. [ 700.112953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.112953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.112953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.112953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.112953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.124254] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 700.523467] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9cb7c2e6-4349-48d6-99e5-5c7645d0482c tempest-ServersV294TestFqdnHostnames-1061498094 tempest-ServersV294TestFqdnHostnames-1061498094-project-member] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 700.523467] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 700.526669] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.526669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.526669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.526669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.526669] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.830211] env[65427]: INFO networking_nsxv3.common.synchronization [None req-95672195-eb7d-4faa-9efd-51bd43b8f678 tempest-ServersV294TestFqdnHostnames-1061498094 tempest-ServersV294TestFqdnHostnames-1061498094-project-member] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 700.830541] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 700.830909] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.831038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.049460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.049460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.049733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.049833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.050813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.050974] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba already deleted. [ 701.051182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.051425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.051483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.051683] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.435030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.435030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.435030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.436317] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.578787] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.578787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.578787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.578787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.578787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.578787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba already deleted. [ 701.578787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.677793] env[65427]: INFO networking_nsxv3.common.synchronization [req-521098a2-a91c-4436-bea3-97f2f27ec7d9 req-bb930ab8-2e92-45e5-b8ff-2f403ed7eadc tempest-TenantUsagesTestJSON-1463397096 tempest-TenantUsagesTestJSON-1463397096-project-member] Enqueued Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 701.680213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 701.680213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.680556] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGHEST for action security_group_members [ 701.680916] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.681089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.681179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.681394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.681681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.681801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.681859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.682106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.682201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.682299] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.941150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.941462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.941462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.941756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.941839] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.942643] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.942643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.942960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.942960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.942960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.943074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.943140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.943226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.943313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.134882] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 702.135331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.147748] env[65427]: INFO networking_nsxv3.common.synchronization [None req-402a9459-4305-416a-8cfc-aa2fe5cc0995 None None] Enqueued Resource ID: 397c851c-6fe5-4f70-b76f-c1cdcb8fe1db with Priority: HIGHEST for action port [ 702.148030] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397c851c-6fe5-4f70-b76f-c1cdcb8fe1db with Priority: HIGHEST for action port [ 702.148539] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-397c851c-6fe5-4f70-b76f-c1cdcb8fe1db taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.149626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-397c851c-6fe5-4f70-b76f-c1cdcb8fe1db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.149626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-397c851c-6fe5-4f70-b76f-c1cdcb8fe1db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.150512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-397c851c-6fe5-4f70-b76f-c1cdcb8fe1db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.150512] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('397c851c-6fe5-4f70-b76f-c1cdcb8fe1db',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.187821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.187821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.187821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.187821] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c is going to be updated. [ 702.214946] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.215127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.215165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.215928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.216104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.228043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: IN_PROGRESS for 2s [ 702.448760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54fe1b7a-483b-4522-ab83-ced21005a9ad: rpc.has_security_group_logging(os_id): False [ 702.471083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.471083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.471083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.471083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.472165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.473597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.473597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.473597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.473597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.473597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.473597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.473597] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 702.547070] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.547070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.547070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.547070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.547070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.564916] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 702.657108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 397c851c-6fe5-4f70-b76f-c1cdcb8fe1db [ 702.657108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.657108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.657108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.657108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.657108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.657108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:397c851c-6fe5-4f70-b76f-c1cdcb8fe1db already deleted. [ 702.657108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-397c851c-6fe5-4f70-b76f-c1cdcb8fe1db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.159067] env[65427]: INFO networking_nsxv3.common.synchronization [req-05adecff-dcf7-4369-a91e-864e4b8fc404 req-34cf1faf-53c7-4e02-9e47-f165b8ee7d6e tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 704.159744] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 704.159981] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.160777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.160851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.161223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.161422] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.161558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.161627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.161790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.161879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.161976] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.240064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c in Status: SUCCESS [ 704.240064] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c deletion is rescheduled due to dependency. [ 704.240064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.579491] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 704.579491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.665561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.665561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.665689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.665805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.665981] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.666126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.666223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.670032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.670032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.670032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 already deleted. [ 704.670032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.681504] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.681721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.681849] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.683032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.683032] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.683032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.683032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.683366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.683366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.683603] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.683603] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.683738] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.683874] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.683905] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.684012] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.684193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.703336] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c6c41a74-6933-4e72-bcab-1946c595fbb5 None None] Enqueued Resource ID: e3e99340-397a-4ab6-8d63-941bb0525539 with Priority: HIGHEST for action port [ 704.705725] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.705725] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.705725] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.705725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.705725] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-f9738e17-0565-4d90-8e9c-c5c09d515d1d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.705725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.705725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.706032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.706144] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9738e17-0565-4d90-8e9c-c5c09d515d1d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.707378] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e99340-397a-4ab6-8d63-941bb0525539 with Priority: HIGHEST for action port [ 704.708440] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e99340-397a-4ab6-8d63-941bb0525539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.708563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e99340-397a-4ab6-8d63-941bb0525539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.708644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e99340-397a-4ab6-8d63-941bb0525539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.708864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e99340-397a-4ab6-8d63-941bb0525539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.708939] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e99340-397a-4ab6-8d63-941bb0525539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.212687] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.212984] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.213189] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.213468] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.213614] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.213763] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port f9738e17-0565-4d90-8e9c-c5c09d515d1d not found, creating... [ 705.214044] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.214356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.214491] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.214705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.214840] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.215189] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.215347] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.215460] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.215712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.215875] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.216040] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: f9738e17-0565-4d90-8e9c-c5c09d515d1d is going to be created. [ 705.217147] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3e99340-397a-4ab6-8d63-941bb0525539 [ 705.217318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.217426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.217512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.217659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.217884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.217884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3e99340-397a-4ab6-8d63-941bb0525539 already deleted. [ 705.217984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e99340-397a-4ab6-8d63-941bb0525539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.240885] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.240885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.240885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.241255] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.242025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.974522] env[65427]: INFO networking_nsxv3.common.synchronization [req-05adecff-dcf7-4369-a91e-864e4b8fc404 req-ae606402-0c74-4075-9068-47aea759eb33 service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 705.974522] env[65427]: INFO networking_nsxv3.common.synchronization [req-05adecff-dcf7-4369-a91e-864e4b8fc404 req-ae606402-0c74-4075-9068-47aea759eb33 service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 705.974522] env[65427]: INFO networking_nsxv3.common.synchronization [req-05adecff-dcf7-4369-a91e-864e4b8fc404 req-ae606402-0c74-4075-9068-47aea759eb33 service nova] Enqueued Resource ID: f9738e17-0565-4d90-8e9c-c5c09d515d1d with Priority: HIGHEST for action port [ 705.975934] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 705.975934] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 705.975934] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9738e17-0565-4d90-8e9c-c5c09d515d1d with Priority: HIGHEST for action port [ 705.976284] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.976485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.976604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.976885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.977019] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.978739] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.978824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.978892] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.980572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.980911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.981206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.981206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.981404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.981566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.981752] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.983747] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9738e17-0565-4d90-8e9c-c5c09d515d1d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.983907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.984014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.984277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.984457] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9738e17-0565-4d90-8e9c-c5c09d515d1d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.487592] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.487592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9738e17-0565-4d90-8e9c-c5c09d515d1d with status ACTIVE [ 706.492366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.492366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9738e17-0565-4d90-8e9c-c5c09d515d1d is going to be updated. [ 706.496908] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.518843] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.519075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.519180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.519414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.519595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.519818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9738e17-0565-4d90-8e9c-c5c09d515d1d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.680299] env[65427]: INFO networking_nsxv3.common.synchronization [None req-511dde2e-379c-453e-b528-8d24f60b7344 None None] Enqueued Resource ID: ed78d309-8ac3-454b-928c-20a674d30fb9 with Priority: HIGHEST for action port [ 706.680299] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed78d309-8ac3-454b-928c-20a674d30fb9 with Priority: HIGHEST for action port [ 706.680299] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed78d309-8ac3-454b-928c-20a674d30fb9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.680299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed78d309-8ac3-454b-928c-20a674d30fb9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.680299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed78d309-8ac3-454b-928c-20a674d30fb9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.680844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed78d309-8ac3-454b-928c-20a674d30fb9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.681064] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed78d309-8ac3-454b-928c-20a674d30fb9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.000332] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.184075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed78d309-8ac3-454b-928c-20a674d30fb9 [ 707.184455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.184566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.184948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.184948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.184948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.185053] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed78d309-8ac3-454b-928c-20a674d30fb9 already deleted. [ 707.185108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed78d309-8ac3-454b-928c-20a674d30fb9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.502956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.503302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.503302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.504403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.504558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.504696] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be created. [ 707.530546] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.530696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.530857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.531076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.531708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.544421] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: UNINITIALIZED for 2s [ 708.917418] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c2557ed6-dc7c-4970-9b36-a0163e544241 None None] Enqueued Resource ID: 93704266-af43-4bf8-bfb5-7649663229d2 with Priority: HIGHEST for action port [ 708.917418] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93704266-af43-4bf8-bfb5-7649663229d2 with Priority: HIGHEST for action port [ 708.917876] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-93704266-af43-4bf8-bfb5-7649663229d2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.917876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93704266-af43-4bf8-bfb5-7649663229d2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.917876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93704266-af43-4bf8-bfb5-7649663229d2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.919045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93704266-af43-4bf8-bfb5-7649663229d2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.919045] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93704266-af43-4bf8-bfb5-7649663229d2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.422898] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93704266-af43-4bf8-bfb5-7649663229d2 [ 709.423296] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.423443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.423506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.427114] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93704266-af43-4bf8-bfb5-7649663229d2 already deleted. [ 709.427114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93704266-af43-4bf8-bfb5-7649663229d2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.560056] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 709.560056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.560056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.560056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.560056] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.560466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.560466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.560528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.560614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.560728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.560840] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.692878] env[65427]: INFO networking_nsxv3.common.synchronization [req-51a4b73b-ff09-42c0-a2a6-a89b824ac3ab req-5e79ef59-789c-4309-b048-1eba33602946 tempest-ServerActionsV293TestJSON-1237020817 tempest-ServerActionsV293TestJSON-1237020817-project-member] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 709.694293] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 709.694747] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.695149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.695317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.695719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.696037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.698210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.698210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.698210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.698210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.698210] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.790756] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a135dae6-964d-4b47-9900-9c6c684c7cd9 tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: 84029977-73db-4ab6-8ef7-db3ee0877238 with Priority: HIGHEST for action security_group_rules [ 709.791358] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84029977-73db-4ab6-8ef7-db3ee0877238 with Priority: HIGHEST for action security_group_rules [ 709.791845] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84029977-73db-4ab6-8ef7-db3ee0877238 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.791845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.791845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.792242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.792242] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84029977-73db-4ab6-8ef7-db3ee0877238',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.984664] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0dae60ed-74dc-4742-80a7-5dd7f8ea3ddf tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: 84029977-73db-4ab6-8ef7-db3ee0877238 with Priority: HIGHEST for action security_group_rules [ 709.989067] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84029977-73db-4ab6-8ef7-db3ee0877238 with Priority: HIGHEST for action security_group_rules [ 709.989972] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84029977-73db-4ab6-8ef7-db3ee0877238 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.990179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.064245] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.064418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.064486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.064720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.064901] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.065026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.065093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.065247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.065337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.065438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.065595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.065689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.065763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.065893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.066041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.066137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.066199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.066346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.066424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.066505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.066596] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.199725] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.199893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.199955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.200280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.200383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.200670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.200799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.200963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.201052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.201193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.201243] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf already deleted. [ 710.201334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.226669] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.226879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.227011] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.227350] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.227616] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.227770] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.227891] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.228118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.228261] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.228482] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.228595] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.228712] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.228817] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.228921] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.229032] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.229159] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.256057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.256242] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.256361] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.256552] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.256995] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.257919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.257919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.257919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.257919] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.315861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.316086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.316489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.316638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.316851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.317200] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84029977-73db-4ab6-8ef7-db3ee0877238 already deleted. [ 710.317200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.317460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.317690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.317839] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84029977-73db-4ab6-8ef7-db3ee0877238',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.358091] env[65427]: INFO networking_nsxv3.common.synchronization [req-10167fce-ad86-4a5e-a0d9-c1f58c039483 req-05ca7a67-846c-4d5e-9ede-8626ff5df355 tempest-FloatingIPsAssociationNegativeTestJSON-1990844324 tempest-FloatingIPsAssociationNegativeTestJSON-1990844324-project-member] Enqueued Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 710.358873] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGHEST for action security_group_members [ 710.359413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.359413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.359573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.359740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.359926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.360050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.360122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.360285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.360365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.360470] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.568783] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f440566-de23-4d5d-b5b9-fdddf6cee691: rpc.has_security_group_logging(os_id): False [ 710.587680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.587888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.587888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.588126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.588245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.588448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.588549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.588613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.588796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.588880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.589095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.589194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.589262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.589445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.589571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.589855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.589985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.590071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.590222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.590323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.590419] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be created. [ 710.650282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.650478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.650478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.650692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.650869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.661873] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 710.761586] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.761843] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.761926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.762323] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.762503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.762692] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf not found, creating... [ 710.762932] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.763115] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.763246] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.765553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.765728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.766051] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.766225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.766343] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.766588] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.766719] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.766854] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf is going to be created. [ 710.789670] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.790213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.790213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.790432] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.790723] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.790990] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.841509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.841680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.841754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.841973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.842087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.842190] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84029977-73db-4ab6-8ef7-db3ee0877238 already deleted. [ 710.842272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84029977-73db-4ab6-8ef7-db3ee0877238" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.862912] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.863204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.863295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.863578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.863578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.863745] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.863850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.863899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.864074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.864144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.864256] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 is going to be updated. [ 710.907374] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.907572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.907648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.907882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.908046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.918072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: IN_PROGRESS for 2s [ 711.544273] env[65427]: INFO networking_nsxv3.common.synchronization [req-51a4b73b-ff09-42c0-a2a6-a89b824ac3ab req-f61a0560-3354-48cc-b2a1-8f3883b6a7be service nova] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 711.544519] env[65427]: INFO networking_nsxv3.common.synchronization [req-51a4b73b-ff09-42c0-a2a6-a89b824ac3ab req-f61a0560-3354-48cc-b2a1-8f3883b6a7be service nova] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 711.544605] env[65427]: INFO networking_nsxv3.common.synchronization [req-51a4b73b-ff09-42c0-a2a6-a89b824ac3ab req-f61a0560-3354-48cc-b2a1-8f3883b6a7be service nova] Enqueued Resource ID: c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf with Priority: HIGHEST for action port [ 711.545174] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_rules [ 711.545319] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 711.545428] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf with Priority: HIGHEST for action port [ 711.545753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.545878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.545948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.546181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.546292] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.547213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.547304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.547378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.547574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.547740] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.547836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.547900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.548072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.548162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.548261] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.552861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.552983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.553063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.553325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.553402] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.055584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.055815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.059302] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.061439] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf with status ACTIVE [ 712.061439] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.061439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.061439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.061439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.061439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.062484] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.062484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.062484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.062604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.062758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.063827] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.063827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.063827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.063827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.063827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.063827] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf is going to be updated. [ 712.090948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.090948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.090948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.091221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.091364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.091530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6f4e82b-5d6c-4bbe-8ea9-138b19b7e9bf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.101692] env[65427]: INFO networking_nsxv3.common.synchronization [req-965e9cb1-77e2-4592-9117-09b2860577ef req-8dec5b84-b81f-4108-ba09-3abb5a62216e tempest-ServersTestMultiNic-1560629134 tempest-ServersTestMultiNic-1560629134-project-member] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 712.102397] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 712.102397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.102582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.102582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.103095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.103095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.103095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.103095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.103354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.103426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.103520] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.453664] env[65427]: INFO networking_nsxv3.common.synchronization [req-965e9cb1-77e2-4592-9117-09b2860577ef req-819c0c14-ce50-4ed0-bbf2-8cfc13649850 tempest-ServersTestMultiNic-1560629134 tempest-ServersTestMultiNic-1560629134-project-member] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 712.454298] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGHEST for action security_group_members [ 712.454680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.454794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.566545] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.605243] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.684798] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 712.685281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.929840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 in Status: SUCCESS [ 712.929840] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 deletion is rescheduled due to dependency. [ 712.929999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.069540] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.069796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.070109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.070318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.070454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.070579] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf is going to be created. [ 713.100901] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.101155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.101213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.101473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.101642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.107755] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.112985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: UNINITIALIZED for 2s [ 713.611044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.611379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.611379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.611507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.611596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.611695] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be updated. [ 713.649938] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.650148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.650239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.650481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.650668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.664937] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: IN_PROGRESS for 2s [ 715.130850] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: SUCCESS [ 715.130850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.130850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.133317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.133317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.133317] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.222329] env[65427]: INFO networking_nsxv3.common.synchronization [req-dbf8ef8e-cb1c-46ff-879a-5c72e1597677 req-487e3e6c-5fa0-40d8-8c78-2bb915ffc420 tempest-VolumesAdminNegativeTest-1107577532 tempest-VolumesAdminNegativeTest-1107577532-project-member] Enqueued Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 715.222885] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 715.226375] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.226375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.226375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.226375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.226375] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.227754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.227754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.227754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.227754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.227754] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.636657] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.661841] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.662064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-348" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.662163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-348" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.662512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-348" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.662777] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.662930] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.663785] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.664099] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.664387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.664811] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.664994] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.665126] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.665236] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.665350] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.665454] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.665590] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.682198] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 715.682337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.682887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.683125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.683355] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.683476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.683543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.683710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.683798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.683893] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.693585] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.693762] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.693897] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.697018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-348" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.697018] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.697018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.697018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.697018] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.697018] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117d9e84-b928-462e-8bb6-c4ccd8c7a2a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.732581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.732581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.732581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.733325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.733325] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 already deleted. [ 715.733325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.892735] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5ed90b4d-ba2a-4b2c-b5f1-b14c3e79b8a9 None None] Enqueued Resource ID: 822beba3-b248-4041-91ec-d5d7a02c0953 with Priority: HIGHEST for action port [ 715.893421] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 822beba3-b248-4041-91ec-d5d7a02c0953 with Priority: HIGHEST for action port [ 715.893753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-822beba3-b248-4041-91ec-d5d7a02c0953 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.893893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-822beba3-b248-4041-91ec-d5d7a02c0953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.893950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-822beba3-b248-4041-91ec-d5d7a02c0953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.896993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-822beba3-b248-4041-91ec-d5d7a02c0953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.897066] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('822beba3-b248-4041-91ec-d5d7a02c0953',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.140710] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf: rpc.has_security_group_logging(os_id): False [ 716.169588] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.169588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.169588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.169893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.171180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.171180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.171180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.171180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.171180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.171496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.171496] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf is going to be created. [ 716.187452] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.187665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.187734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.188011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.188128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.189036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.189036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.189036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.189036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.189036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.189036] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be updated. [ 716.198687] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.199343] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.199343] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.199653] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.199836] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.200140] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 not found, creating... [ 716.200517] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.200708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.200834] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.201352] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.201550] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.201941] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.202119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.202240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.202610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.202812] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.203013] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 is going to be created. [ 716.229995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.230123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.230282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.230701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.231067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.245944] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.246230] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.246380] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.246687] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.247067] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.247432] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.249418] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: IN_PROGRESS for 2s [ 716.255379] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.255538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.255815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.255876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.256044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.275740] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: IN_PROGRESS for 2s [ 716.400515] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 822beba3-b248-4041-91ec-d5d7a02c0953 [ 716.401328] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.401328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.401328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.401618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.401618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.401618] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:822beba3-b248-4041-91ec-d5d7a02c0953 already deleted. [ 716.401702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-822beba3-b248-4041-91ec-d5d7a02c0953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.981865] env[65427]: INFO networking_nsxv3.common.synchronization [req-dbf8ef8e-cb1c-46ff-879a-5c72e1597677 req-9a7c8172-5c5f-4220-bfdb-0253d7f10eba service nova] Enqueued Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_rules [ 716.982674] env[65427]: INFO networking_nsxv3.common.synchronization [req-dbf8ef8e-cb1c-46ff-879a-5c72e1597677 req-9a7c8172-5c5f-4220-bfdb-0253d7f10eba service nova] Enqueued Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 716.982882] env[65427]: INFO networking_nsxv3.common.synchronization [req-dbf8ef8e-cb1c-46ff-879a-5c72e1597677 req-9a7c8172-5c5f-4220-bfdb-0253d7f10eba service nova] Enqueued Resource ID: 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 with Priority: HIGHEST for action port [ 716.986973] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_rules [ 716.986973] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 716.986973] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 with Priority: HIGHEST for action port [ 716.986973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.986973] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.986973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.986973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.987881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.987881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.987881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.987881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.987881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.987881] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.990391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.990391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.990391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.990391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.990391] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117d9e84-b928-462e-8bb6-c4ccd8c7a2a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.494315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.494315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.494315] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.494315] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 with status ACTIVE [ 717.494315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.494315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.494315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.494315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.494315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.494315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.495202] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.495578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.495578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.495578] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 117d9e84-b928-462e-8bb6-c4ccd8c7a2a9 is going to be updated. [ 717.519150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.519285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.519333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.519817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.520131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.520131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117d9e84-b928-462e-8bb6-c4ccd8c7a2a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.755242] env[65427]: INFO networking_nsxv3.common.synchronization [req-8952c5d3-dfa4-4299-938b-5ac86a9afeae req-43fd2d14-bef1-466d-8456-5c3537e495c0 tempest-ServersTestManualDisk-660276821 tempest-ServersTestManualDisk-660276821-project-member] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 717.755780] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 717.756321] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.756760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.756760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.756931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.757222] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.757342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.757792] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.998976] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.147517] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.147709] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-330" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.148318] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-330" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.148420] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-330" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.148802] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.148902] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.148957] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.149223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.149328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.149530] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.151085] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.151085] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.151085] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.151085] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.151085] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.151085] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.168738] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.169275] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.169275] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.169275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-330" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.169434] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-7d6acab5-cf0b-4daf-a224-06cc960b14c6 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.170025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.170025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.170143] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.170177] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6acab5-cf0b-4daf-a224-06cc960b14c6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.261185] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.261347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.261419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.261635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.261728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.261929] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.262036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.262102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.262252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.262331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.262415] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e already deleted. [ 718.262496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.265893] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 in Status: SUCCESS [ 718.266084] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 deletion is rescheduled due to dependency. [ 718.266187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.288443] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: SUCCESS [ 718.288443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.343300] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7d1d88a2-a98b-43bf-8858-6861f00c2fd9 None None] Enqueued Resource ID: 5b89881e-482b-4604-902a-ed7c10363f4b with Priority: HIGHEST for action port [ 718.343918] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b89881e-482b-4604-902a-ed7c10363f4b with Priority: HIGHEST for action port [ 718.344240] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b89881e-482b-4604-902a-ed7c10363f4b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.344371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b89881e-482b-4604-902a-ed7c10363f4b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.344439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b89881e-482b-4604-902a-ed7c10363f4b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.344693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b89881e-482b-4604-902a-ed7c10363f4b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.344774] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b89881e-482b-4604-902a-ed7c10363f4b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.504200] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.504200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.504200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.504602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.504602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.504711] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 is going to be created. [ 718.534623] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.535315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.535442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.535682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.536412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.550945] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: UNINITIALIZED for 2s [ 718.672946] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.673117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.673163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.673499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.673684] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.673903] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 7d6acab5-cf0b-4daf-a224-06cc960b14c6 not found, creating... [ 718.674139] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.674321] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.674438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.674672] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.674808] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.676671] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.676671] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.676873] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.676987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.677140] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.677302] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 7d6acab5-cf0b-4daf-a224-06cc960b14c6 is going to be created. [ 718.721162] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.721408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.721408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.721696] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.721928] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.722219] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.847124] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b89881e-482b-4604-902a-ed7c10363f4b [ 718.848145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.848145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.848145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.848145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.848145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.848145] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b89881e-482b-4604-902a-ed7c10363f4b already deleted. [ 718.848145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b89881e-482b-4604-902a-ed7c10363f4b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.930304] env[65427]: INFO networking_nsxv3.common.synchronization [None req-43c5586a-47f2-4ca2-b6f7-fa7a72298014 None None] Enqueued Resource ID: 411743ee-fd9b-46ff-b5f6-c22f3f40c399 with Priority: HIGHEST for action port [ 718.930703] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 411743ee-fd9b-46ff-b5f6-c22f3f40c399 with Priority: HIGHEST for action port [ 718.932398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-411743ee-fd9b-46ff-b5f6-c22f3f40c399 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.932583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-411743ee-fd9b-46ff-b5f6-c22f3f40c399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.932678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-411743ee-fd9b-46ff-b5f6-c22f3f40c399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.932973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-411743ee-fd9b-46ff-b5f6-c22f3f40c399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.933109] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('411743ee-fd9b-46ff-b5f6-c22f3f40c399',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.435840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 411743ee-fd9b-46ff-b5f6-c22f3f40c399 [ 719.437303] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.437303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.437303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.437303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.437303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.437303] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:411743ee-fd9b-46ff-b5f6-c22f3f40c399 already deleted. [ 719.437303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-411743ee-fd9b-46ff-b5f6-c22f3f40c399" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.450228] env[65427]: INFO networking_nsxv3.common.synchronization [req-8952c5d3-dfa4-4299-938b-5ac86a9afeae req-eac3ac90-7e4f-49ff-ba72-3dbbb4135bdf service nova] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 719.450228] env[65427]: INFO networking_nsxv3.common.synchronization [req-8952c5d3-dfa4-4299-938b-5ac86a9afeae req-eac3ac90-7e4f-49ff-ba72-3dbbb4135bdf service nova] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 719.450228] env[65427]: INFO networking_nsxv3.common.synchronization [req-8952c5d3-dfa4-4299-938b-5ac86a9afeae req-eac3ac90-7e4f-49ff-ba72-3dbbb4135bdf service nova] Enqueued Resource ID: 7d6acab5-cf0b-4daf-a224-06cc960b14c6 with Priority: HIGHEST for action port [ 719.450228] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_rules [ 719.450822] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 719.455555] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d6acab5-cf0b-4daf-a224-06cc960b14c6 with Priority: HIGHEST for action port [ 719.455555] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.455555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.455555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.455555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.455555] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.456762] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.456873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.456933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.457181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.457255] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.457343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.457402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.457610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.457610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.457855] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.459496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d6acab5-cf0b-4daf-a224-06cc960b14c6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.459663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.459758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.459888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.459975] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6acab5-cf0b-4daf-a224-06cc960b14c6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.961713] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.965054] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d6acab5-cf0b-4daf-a224-06cc960b14c6 with status ACTIVE [ 719.965054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965054] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d6acab5-cf0b-4daf-a224-06cc960b14c6 is going to be updated. [ 719.966406] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.966406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.004760] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.004760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.004760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.004760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.004760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.004760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d6acab5-cf0b-4daf-a224-06cc960b14c6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.467561] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.566531] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: SUCCESS [ 720.566941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.568076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.568076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.568552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.568631] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.973679] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.973679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.973679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.973679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.973679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.973679] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e is going to be created. [ 721.000177] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.000316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.000385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.000639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.003034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.019397] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: UNINITIALIZED for 2s [ 721.073530] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.075248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.075248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.076376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.076458] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.076632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.076698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.076996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.077193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.077343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.077602] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.077761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.077857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.079098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.079669] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.079916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.080208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.080495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.082047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.082047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.082047] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.269836] env[65427]: INFO networking_nsxv3.common.synchronization [None req-29e1ef08-f999-40ab-ba7f-029d1e67bfba None None] Enqueued Resource ID: 63de094e-dfd6-4386-ac29-eee7c21a01f8 with Priority: HIGHEST for action port [ 721.271408] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63de094e-dfd6-4386-ac29-eee7c21a01f8 with Priority: HIGHEST for action port [ 721.271408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-63de094e-dfd6-4386-ac29-eee7c21a01f8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.271408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63de094e-dfd6-4386-ac29-eee7c21a01f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.271408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63de094e-dfd6-4386-ac29-eee7c21a01f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.273153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63de094e-dfd6-4386-ac29-eee7c21a01f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.273426] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63de094e-dfd6-4386-ac29-eee7c21a01f8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.585621] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7c8992c-2da4-43aa-a91a-0a4902c45817: rpc.has_security_group_logging(os_id): False [ 721.608262] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.608262] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.608262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.608837] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.608837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.608837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.611897] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.611897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.611897] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 is going to be created. [ 721.686358] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.686512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.686583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.686825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.686994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.703248] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: IN_PROGRESS for 2s [ 721.779096] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63de094e-dfd6-4386-ac29-eee7c21a01f8 [ 721.779485] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.779616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.779616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.779788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.779881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.779986] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63de094e-dfd6-4386-ac29-eee7c21a01f8 already deleted. [ 721.780120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63de094e-dfd6-4386-ac29-eee7c21a01f8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.647323] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5bd9474e-c939-479a-a4e0-20824f4ada54 tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 722.647967] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 722.650361] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.650650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.650716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.650997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.651096] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.026678] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2b81ed01-284b-4f9d-9d08-1affd0375c2b tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 723.027507] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 723.028411] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.028532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.038461] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: SUCCESS [ 723.038950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.040028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.040113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.040293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.040414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.040494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.040662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.040748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.040836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.040934] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.176928] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.177104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.177179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.177416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.177533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.177635] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc already deleted. [ 723.177734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.177898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.178128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.178217] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.435218] env[65427]: INFO networking_nsxv3.common.synchronization [req-83049a3a-e93c-4b67-b70d-9721de532875 req-4b10db2a-4d4b-4e4e-b9ca-d228093e5893 tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 723.435837] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 723.436557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.436670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.436737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.436958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.438045] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.438045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.438045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.438045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.438045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.438045] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.544286] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.722312] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.722759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.722759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.723511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723554] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc already deleted. [ 723.724260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.728485] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: SUCCESS [ 723.728709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.940351] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.048282] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06cf1e57-ae2c-4617-80cf-281da56f6c6e: rpc.has_security_group_logging(os_id): False [ 724.075095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.075095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.075095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.075095] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e is going to be created. [ 724.154627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.156958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.156958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.156958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.156958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.170275] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.170482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.170482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.171209] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.171529] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.171755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.171863] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.172143] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.172188] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.172402] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.172532] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.172638] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.172740] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.172844] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.172944] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.173148] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.181041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: IN_PROGRESS for 2s [ 724.219418] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.219699] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.219831] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.220054] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.220449] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-79515ef0-e2ca-49b3-8ac0-e561a046f74e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.220666] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.220792] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.221171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.221339] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79515ef0-e2ca-49b3-8ac0-e561a046f74e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.445448] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.725110] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.725511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.725511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.725714] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.725934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.726126] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 79515ef0-e2ca-49b3-8ac0-e561a046f74e not found, creating... [ 724.726448] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.726683] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.726814] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.727077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.727231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.727564] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.727725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.727838] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.728071] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.728207] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.728354] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 79515ef0-e2ca-49b3-8ac0-e561a046f74e is going to be created. [ 724.757023] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.757256] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.757381] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.757647] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.757877] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.758146] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.952069] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.952295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.952295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.952713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.952713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.952713] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 724.997969] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.998189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.998292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.998584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.998789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.012830] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 725.506414] env[65427]: INFO networking_nsxv3.common.synchronization [req-83049a3a-e93c-4b67-b70d-9721de532875 req-62ca46f7-07a5-431b-ac95-a3f4cc6dba4c service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 725.506588] env[65427]: INFO networking_nsxv3.common.synchronization [req-83049a3a-e93c-4b67-b70d-9721de532875 req-62ca46f7-07a5-431b-ac95-a3f4cc6dba4c service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 725.506718] env[65427]: INFO networking_nsxv3.common.synchronization [req-83049a3a-e93c-4b67-b70d-9721de532875 req-62ca46f7-07a5-431b-ac95-a3f4cc6dba4c service nova] Enqueued Resource ID: 79515ef0-e2ca-49b3-8ac0-e561a046f74e with Priority: HIGHEST for action port [ 725.507333] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 725.507470] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 725.507555] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79515ef0-e2ca-49b3-8ac0-e561a046f74e with Priority: HIGHEST for action port [ 725.507983] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.515291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.515291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.515291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.515291] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.515291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.515291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.515291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-79515ef0-e2ca-49b3-8ac0-e561a046f74e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.515291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.517283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.519240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.519319] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79515ef0-e2ca-49b3-8ac0-e561a046f74e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.687138] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a6034a7f-9141-4a02-bd14-29e9410421ff None None] Enqueued Resource ID: 22730fbd-cb6c-4397-864f-c5b8c3a580ff with Priority: HIGHEST for action port [ 725.688247] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22730fbd-cb6c-4397-864f-c5b8c3a580ff with Priority: HIGHEST for action port [ 725.689201] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-22730fbd-cb6c-4397-864f-c5b8c3a580ff taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.689416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22730fbd-cb6c-4397-864f-c5b8c3a580ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.689498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22730fbd-cb6c-4397-864f-c5b8c3a580ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.689891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22730fbd-cb6c-4397-864f-c5b8c3a580ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.690190] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22730fbd-cb6c-4397-864f-c5b8c3a580ff',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.022031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.022423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.027195] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79515ef0-e2ca-49b3-8ac0-e561a046f74e with status ACTIVE [ 726.027195] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.027405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.027444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.027650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.027767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.027997] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.028137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.028451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.028451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.028451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.028681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.028765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.029498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.029498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.029498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.029498] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79515ef0-e2ca-49b3-8ac0-e561a046f74e is going to be updated. [ 726.056369] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.056369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.056369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.056637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.056673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.056830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79515ef0-e2ca-49b3-8ac0-e561a046f74e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.192578] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22730fbd-cb6c-4397-864f-c5b8c3a580ff [ 726.192814] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.192961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.193053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.193276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.193381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.193473] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22730fbd-cb6c-4397-864f-c5b8c3a580ff already deleted. [ 726.193551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22730fbd-cb6c-4397-864f-c5b8c3a580ff" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.196469] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: SUCCESS [ 726.196741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.333339] env[65427]: INFO networking_nsxv3.common.synchronization [req-c68cb59e-0ac2-4471-a653-5da4abb66fbe req-a386f434-4e3d-43f0-8da8-c7943e9aec09 tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 726.334477] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 726.334477] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.334711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.334711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.334848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.335030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.335142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.335205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.335360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.335707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.335707] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.783481] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-952 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.783481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-952" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.783481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-952" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.783481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-952" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.783481] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.783481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.783481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.783994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.783994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.784098] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.784152] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.786040] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.786040] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.786040] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.786040] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.786040] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.808434] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.808434] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.808718] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.808786] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-952" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.809083] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-dde07091-d397-473a-96d2-9ac0b1352702 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.809292] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.809477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.809781] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.809933] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde07091-d397-473a-96d2-9ac0b1352702',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.839626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.839841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.839841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.840120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.840234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.840440] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.840559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.840621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.840771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.840848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.840943] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f already deleted. [ 726.841040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.025336] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 727.025623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.025777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.026015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.026253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.026444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.026552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.026725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.026810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.026927] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.313088] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.313337] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.313540] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.313951] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.314215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.314477] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port dde07091-d397-473a-96d2-9ac0b1352702 not found, creating... [ 727.315169] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.315169] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.315368] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.316127] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.316127] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.316365] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.316623] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.316821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.317168] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.317395] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.317623] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: dde07091-d397-473a-96d2-9ac0b1352702 is going to be created. [ 727.342349] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.342511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.343662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.343662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.343662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.343662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.530252] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.036697] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.088806] env[65427]: INFO networking_nsxv3.common.synchronization [req-c68cb59e-0ac2-4471-a653-5da4abb66fbe req-28efe384-b6f0-4bdd-abd2-a7d646ac615a service nova] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 728.088923] env[65427]: INFO networking_nsxv3.common.synchronization [req-c68cb59e-0ac2-4471-a653-5da4abb66fbe req-28efe384-b6f0-4bdd-abd2-a7d646ac615a service nova] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 728.089519] env[65427]: INFO networking_nsxv3.common.synchronization [req-c68cb59e-0ac2-4471-a653-5da4abb66fbe req-28efe384-b6f0-4bdd-abd2-a7d646ac615a service nova] Enqueued Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 728.090567] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 728.090725] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 728.090828] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 728.091766] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.091899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.092034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.092857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.092857] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.093341] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.093608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.093608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.093801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.094038] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.094156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.094242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.094409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.094521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.094640] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.095851] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde07091-d397-473a-96d2-9ac0b1352702 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.095851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.095851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.096075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.096075] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde07091-d397-473a-96d2-9ac0b1352702',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.402063] env[65427]: INFO networking_nsxv3.common.synchronization [req-6cad1348-412c-414a-b13d-7fd925d3160f req-93914e41-bac0-4c8d-abe8-c8ae2eb00419 tempest-ServersAdminNegativeTestJSON-513132739 tempest-ServersAdminNegativeTestJSON-513132739-project-member] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 728.402667] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 728.402985] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.403146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.403209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.403478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.403646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.403765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.403827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.403977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.404078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.404193] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.540189] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.540189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.540189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.540189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.540189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.540189] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 728.585803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.586270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.586270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.586529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.586744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.598385] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 728.598992] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.599831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.600067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.600939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde07091-d397-473a-96d2-9ac0b1352702 with status ACTIVE [ 728.601226] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.601340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.601936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.601936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.601936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.602474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.602474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.602474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.602654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.602687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.603207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.603207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.603207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.603384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.603415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.604386] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde07091-d397-473a-96d2-9ac0b1352702 is going to be updated. [ 728.643680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.643837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.643889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.644250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.644516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.644730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.750377] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.750577] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.750697] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.750972] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.751520] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.751915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.751915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.752676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.752898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.754008] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.754187] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.754355] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.754492] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.754630] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.755524] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.755788] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.760616] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c8e3caa7-98a8-4068-97f1-d153e5d84f23 None None] Enqueued Resource ID: 1ba76934-59d7-4dfd-aa38-cad0fb52dff3 with Priority: HIGHEST for action port [ 728.762110] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba76934-59d7-4dfd-aa38-cad0fb52dff3 with Priority: HIGHEST for action port [ 728.762889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ba76934-59d7-4dfd-aa38-cad0fb52dff3 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.763100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ba76934-59d7-4dfd-aa38-cad0fb52dff3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.763207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ba76934-59d7-4dfd-aa38-cad0fb52dff3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.763634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ba76934-59d7-4dfd-aa38-cad0fb52dff3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.763793] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ba76934-59d7-4dfd-aa38-cad0fb52dff3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.791345] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.791545] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.791669] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.791850] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.792317] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-daf570ba-a008-416b-b123-18b838fc900c taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.792529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.792650] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.792996] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.793150] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daf570ba-a008-416b-b123-18b838fc900c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.906637] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.101577] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.266204] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ba76934-59d7-4dfd-aa38-cad0fb52dff3 [ 729.266553] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.266722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.266800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.267199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.267262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.267812] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ba76934-59d7-4dfd-aa38-cad0fb52dff3 already deleted. [ 729.267812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ba76934-59d7-4dfd-aa38-cad0fb52dff3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.297331] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.298030] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.298030] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.298222] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.298278] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.298673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port daf570ba-a008-416b-b123-18b838fc900c not found, creating... [ 729.298673] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.298833] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.298944] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.299203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.299421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.299766] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.300022] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.300190] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.300426] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.300605] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.300771] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: daf570ba-a008-416b-b123-18b838fc900c is going to be created. [ 729.342837] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.342837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.343179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.343523] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.343898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.344284] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.409206] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.605521] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.605723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.605798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.606189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.606330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.606436] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be created. [ 729.633822] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.634065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.634118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.634336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.634517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.645642] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: UNINITIALIZED for 2s [ 729.911626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.911820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.911820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.912195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.912339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.912488] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be updated. [ 729.945446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.945686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.945800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.946078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.946281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.958975] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 730.099396] env[65427]: INFO networking_nsxv3.common.synchronization [req-6cad1348-412c-414a-b13d-7fd925d3160f req-9f806b62-48c5-4653-a60a-767abba3fb2a service nova] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_rules [ 730.099559] env[65427]: INFO networking_nsxv3.common.synchronization [req-6cad1348-412c-414a-b13d-7fd925d3160f req-9f806b62-48c5-4653-a60a-767abba3fb2a service nova] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 730.099778] env[65427]: INFO networking_nsxv3.common.synchronization [req-6cad1348-412c-414a-b13d-7fd925d3160f req-9f806b62-48c5-4653-a60a-767abba3fb2a service nova] Enqueued Resource ID: daf570ba-a008-416b-b123-18b838fc900c with Priority: HIGHEST for action port [ 730.100603] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_rules [ 730.100832] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 730.100832] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daf570ba-a008-416b-b123-18b838fc900c with Priority: HIGHEST for action port [ 730.101088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.101237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.101311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.101517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.101611] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.102601] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.102703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.102941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-daf570ba-a008-416b-b123-18b838fc900c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.103165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.103165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.103868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.103868] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('daf570ba-a008-416b-b123-18b838fc900c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.606204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.606437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.608843] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port daf570ba-a008-416b-b123-18b838fc900c with status ACTIVE [ 730.609126] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.609248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.609299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.609486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.609592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.609852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.609930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.609982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.610179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.610278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.610522] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.610598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.610629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.610760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.610828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.610952] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: daf570ba-a008-416b-b123-18b838fc900c is going to be updated. [ 730.631461] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 730.631689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.631875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.632108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.632326] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.632478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.632550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.632733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.632820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.632907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.633016] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.649373] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.649558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.649627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.649843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.650642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.650642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-daf570ba-a008-416b-b123-18b838fc900c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.135870] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.136304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.136304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.136438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.136595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.136759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.136850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.137336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.137336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.137503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.137599] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.137735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.137845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.138084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.138317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.138460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.138555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.138756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.138891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.139026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.139165] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.336371] env[65427]: INFO networking_nsxv3.common.synchronization [req-374ce6d8-15ab-4c6d-a6c9-1ece32860881 req-d348086f-fdf1-4302-8e2d-1892d3edec52 tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 731.336371] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 731.336711] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.336983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.337200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.337595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.337858] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.338081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.338541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.338691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.340079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.340079] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.643603] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f440566-de23-4d5d-b5b9-fdddf6cee691: rpc.has_security_group_logging(os_id): False [ 731.660045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 731.660045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.660045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.660045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.660045] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.660045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.660045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.660641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.660641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.660641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.660641] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.668545] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.668545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.668545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.671269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.671269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.671269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.672025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.672025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.672025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.672191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.672275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.672364] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 731.752190] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.752323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.752323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.753253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.753253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.772714] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 731.808575] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.808846] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.808984] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.810083] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.810236] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.810421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.810537] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.811063] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.811063] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.811415] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.811415] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.811607] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.811607] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.811718] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.813384] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.813384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.842954] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.852406] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.852406] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.852406] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.852406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-759" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.852406] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.852406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.852406] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.854346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.854603] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faeeba5f-7f24-41e7-ba65-9c1d03767ce3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.975094] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 731.975285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.975512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.976159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.976159] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.976300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.976349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.976537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.976670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.976817] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.175244] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.348663] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.357837] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.358244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.358365] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.358635] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.358852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.359131] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port faeeba5f-7f24-41e7-ba65-9c1d03767ce3 not found, creating... [ 732.360389] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.360551] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.360737] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.360985] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.362315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.362809] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.363086] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.363349] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.363702] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.363896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.364120] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: faeeba5f-7f24-41e7-ba65-9c1d03767ce3 is going to be created. [ 732.393063] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.393275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.393275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.393606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.393825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.394113] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.479101] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.678932] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef110958-8d53-4daf-a376-677eb87ffe7f: rpc.has_security_group_logging(os_id): False [ 732.698592] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.698676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.698710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.698915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.699018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.699272] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.699414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.699504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.699660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.699742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.700330] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be created. [ 732.742616] env[65427]: INFO networking_nsxv3.common.synchronization [None req-65a7a67f-ad16-45c4-93ba-3f1d0f90899c tempest-ServersTestFqdnHostnames-2109873929 tempest-ServersTestFqdnHostnames-2109873929-project-member] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 732.742664] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 732.742937] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.743188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.743188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.743526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.743616] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.766954] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.767131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.767206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.767629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.767834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.785030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 732.854100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.854100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.854100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.854100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.854100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.854535] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 732.897718] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9945281f-a55d-47ec-b7d1-15d92ffab3f5 tempest-ServersTestFqdnHostnames-2109873929 tempest-ServersTestFqdnHostnames-2109873929-project-member] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 732.898797] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 732.899237] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.899384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.908037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.908037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.908037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.908037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.908037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.923780] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 732.986852] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.242837] env[65427]: INFO networking_nsxv3.common.synchronization [req-374ce6d8-15ab-4c6d-a6c9-1ece32860881 req-9492d12e-176b-4585-b8ad-c1651d00424f service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 733.243391] env[65427]: INFO networking_nsxv3.common.synchronization [req-374ce6d8-15ab-4c6d-a6c9-1ece32860881 req-9492d12e-176b-4585-b8ad-c1651d00424f service nova] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 733.243391] env[65427]: INFO networking_nsxv3.common.synchronization [req-374ce6d8-15ab-4c6d-a6c9-1ece32860881 req-9492d12e-176b-4585-b8ad-c1651d00424f service nova] Enqueued Resource ID: faeeba5f-7f24-41e7-ba65-9c1d03767ce3 with Priority: HIGHEST for action port [ 733.244236] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_rules [ 733.244346] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 733.244435] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faeeba5f-7f24-41e7-ba65-9c1d03767ce3 with Priority: HIGHEST for action port [ 733.244728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.244842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.244895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.245183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.245272] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.247683] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.247683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.247909] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.249308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.249506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.250170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.250303] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faeeba5f-7f24-41e7-ba65-9c1d03767ce3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.276997] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.277697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.277697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.277697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.277871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.277871] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a already deleted. [ 733.277929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.278118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.278228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.278313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.490472] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.490579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.490579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.490802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.490899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.491010] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be updated. [ 733.529207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.529370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.529411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.529630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.530420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.542828] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 733.550948] env[65427]: INFO networking_nsxv3.common.synchronization [req-985fbd55-5365-4aa7-bd2d-4e4689b06134 req-299ccdeb-bc7c-4df5-8574-fbebf7069f74 tempest-FloatingIPsAssociationTestJSON-904560228 tempest-FloatingIPsAssociationTestJSON-904560228-project-member] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 733.552364] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGHEST for action security_group_members [ 733.552907] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.553883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.553883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.553883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.553883] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.554058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.554144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.554830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.554830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.554830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.755693] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.755693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.755693] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port faeeba5f-7f24-41e7-ba65-9c1d03767ce3 with status ACTIVE [ 733.755693] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.756109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.756109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.756109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.756109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.756314] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.756386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.756530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.756703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.756703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.757122] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.757122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.757122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.757451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.757451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.757451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: faeeba5f-7f24-41e7-ba65-9c1d03767ce3 is going to be updated. [ 733.792024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 733.792024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.797191] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.797368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.797434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.797678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.797828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.798013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faeeba5f-7f24-41e7-ba65-9c1d03767ce3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.805916] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.806223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.806323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.806575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.806757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.806926] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a already deleted. [ 733.807082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.057285] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.057586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.057635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.057848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.057947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.058233] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.058356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.058461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.058582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.058788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.058833] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be updated. [ 734.106204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.106403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.106505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.106785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.107047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.118535] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: IN_PROGRESS for 2s [ 734.800495] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 734.800956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.937969] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 734.938233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.938417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.938677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.938838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.938958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.939135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.939375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.939474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.939585] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.158335] env[65427]: INFO networking_nsxv3.common.synchronization [None req-8b9975cb-fde7-41ae-a627-45bae6bd7fd9 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 735.158335] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 735.158335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.161830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.161830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.161830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.161830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.295126] env[65427]: INFO networking_nsxv3.common.synchronization [None req-53ba2132-5d57-4695-9b3f-b7537d4278bf tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 735.295648] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 735.295974] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.300224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.444113] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.557057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.557057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.557057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.557057] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.687022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.687022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c already deleted. [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.687022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687022] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.947072] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.974755] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-774ea3ef-fa16-4f70-9178-49b4ec6e4542 tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 735.975326] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 735.975861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.975861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.975861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.976235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.976586] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.976586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.976586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.976737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.976833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.976888] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.060599] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.060599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.060927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.061041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.062170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.062170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.062170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.062170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.062170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.062170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.063113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.063113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.063113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.063113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.063657] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.063657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.063657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.063905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.064031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.064193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.064902] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.131381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e055f6e8-5bdf-4d73-ac15-366894643fcc in Status: SUCCESS [ 736.131662] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc deletion is rescheduled due to dependency. [ 736.131662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.214734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.214734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.214734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.214734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.214734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.214734] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c already deleted. [ 736.214734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.449525] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.449685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.449760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.449977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.450209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.450209] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 736.466842] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.467048] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.467172] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.467531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.467802] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.468186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.468186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.468299] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.468465] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.468675] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.468785] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.468890] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.468993] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.469109] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.469208] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.469335] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.479297] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.479443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.479496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.480100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.480100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.480100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.480272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.480272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.480341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.481138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.481138] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 already deleted. [ 736.481138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.488570] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.488846] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.488992] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.489175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.489471] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-e9da2d21-8861-4eb6-92d3-c47231c1503a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.489634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.489746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.490331] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.490331] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9da2d21-8861-4eb6-92d3-c47231c1503a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.492894] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.493027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.493085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.493267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.493653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.504793] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 736.567979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 584eb45a-7106-4759-8924-ff61fcdd399f: rpc.has_security_group_logging(os_id): False [ 736.586270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.586473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.586542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.586746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.586841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.587047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.587150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.587336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.587501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.587677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.587841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.587947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.588011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.588166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.588241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.588440] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.588531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.588593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.588731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.588798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.588881] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be updated. [ 736.667722] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.668069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.668069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.668069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.668189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.681269] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 736.993391] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.993883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.993883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.994025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.994074] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.994231] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port e9da2d21-8861-4eb6-92d3-c47231c1503a not found, creating... [ 736.994523] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.994689] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.994834] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.995074] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.995215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.995499] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.995655] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.995764] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.995965] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.996128] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.996295] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: e9da2d21-8861-4eb6-92d3-c47231c1503a is going to be created. [ 737.018886] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.019126] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.019231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.019655] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.019931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.020130] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.545663] env[65427]: INFO networking_nsxv3.common.synchronization [req-8de68c0c-b130-4579-aaf4-d0aae3dda9d0 req-01889b36-36c1-47a6-bf86-be9ba8e2680c tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 737.546566] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 737.547020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.547207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.548720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.548720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.548720] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.549167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.549383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.549633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.549755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.549908] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.754526] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-03e89767-aa2f-458a-b291-ffd0bae2be4e service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 737.754526] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-03e89767-aa2f-458a-b291-ffd0bae2be4e service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 737.754664] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-03e89767-aa2f-458a-b291-ffd0bae2be4e service nova] Enqueued Resource ID: e9da2d21-8861-4eb6-92d3-c47231c1503a with Priority: HIGHEST for action port [ 737.755396] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 737.755396] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 737.755507] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9da2d21-8861-4eb6-92d3-c47231c1503a with Priority: HIGHEST for action port [ 737.755775] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.756118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.756118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.756490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.756591] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.757935] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.758555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.758555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.758555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.758555] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.758555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.758961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.759011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.759155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.759228] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.760945] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9da2d21-8861-4eb6-92d3-c47231c1503a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.760945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.760945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.761163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.761204] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9da2d21-8861-4eb6-92d3-c47231c1503a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.052729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.053039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.053039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.053330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.053476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.053706] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.053863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.053936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.054175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.054273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.054388] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 738.084935] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.085396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.085485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.086487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.086487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.095751] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 738.260965] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.266028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9da2d21-8861-4eb6-92d3-c47231c1503a with status ACTIVE [ 738.266152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.266311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.266376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.266583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.266674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.266858] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.266959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.267060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.267440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.267440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.267541] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.267541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.267636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.267832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.267832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.267925] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9da2d21-8861-4eb6-92d3-c47231c1503a is going to be updated. [ 738.271188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.274145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.302256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.302256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.302256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.302256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.302256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.302256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9da2d21-8861-4eb6-92d3-c47231c1503a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.512624] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-7a33985f-a047-48f0-b1ff-7ea8f0e2e9e1 tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 738.512624] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 738.512624] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.512624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.519752] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 738.519925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.520118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.520343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.520581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.520723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.520799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.520954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.521214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.521214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.521214] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.701019] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 738.701453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.768647] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.924703] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.924703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.924839] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.925291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.925383] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.925587] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.925721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.926872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.927298] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.927585] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.927720] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.927893] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.928074] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.928228] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.928349] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.928488] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.954032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.954198] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.954484] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.955061] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.955320] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.955599] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.955713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.956212] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.956212] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.023288] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.023813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.023813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.024038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.024135] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.024292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.024354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.024550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.024632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.024748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.025038] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.025139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.025139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.025421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.025709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.025850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.025938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.026144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.026257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.026362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.027197] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.271710] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.271710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.271710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.272598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.272598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.272598] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be created. [ 739.308354] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.308354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.308354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.308653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.309347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.323848] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: UNINITIALIZED for 2s [ 739.462092] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.462092] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 not found, creating... [ 739.462092] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.462092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.463429] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.465740] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.465740] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.465740] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.465740] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.465740] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 is going to be created. [ 739.490143] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.490513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.490723] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.491106] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.491357] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.491705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.530522] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5de73072-1420-4348-9a8f-7aea1d3f3f89: rpc.has_security_group_logging(os_id): False [ 739.554597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.555321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.555321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.555321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.555321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.555580] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.555749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.555816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.556032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.556129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.556818] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.556949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.557063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.557427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.557618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.557997] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.558146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.558239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.558451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.558543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.558649] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 739.671783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.671991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.672085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.672303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.672453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.691769] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 740.108999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 740.109274] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 740.109374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.264965] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-ee3da19b-921f-478f-8b47-409eaa549ff1 service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 740.265361] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-ee3da19b-921f-478f-8b47-409eaa549ff1 service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 740.265484] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-ee3da19b-921f-478f-8b47-409eaa549ff1 service nova] Enqueued Resource ID: 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 with Priority: HIGHEST for action port [ 740.266298] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 740.266533] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 740.266706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 with Priority: HIGHEST for action port [ 740.267127] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.267285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.267663] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.267736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.268017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.268212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.268277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.268637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.268770] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.612826] env[65427]: INFO networking_nsxv3.common.synchronization [req-2e3ddfbd-45ae-435d-8b0c-e3f672d8e1a9 req-661a56e0-ad90-460a-960d-b01fb8835973 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 740.612826] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 740.613890] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.617023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.617023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.617023] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.771778] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 with status ACTIVE [ 740.771911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.772086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.772147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.772977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.773103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.773481] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.773481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.773573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.773736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.773819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.774019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.774123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.774218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.774311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.774402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.774489] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5 is going to be updated. [ 740.799590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.799590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.799590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.799850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.799850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.800037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-397ce0c8-c6e6-4d70-981b-2f7c8e21a2c5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.832699] env[65427]: INFO networking_nsxv3.common.synchronization [req-96bfd2bb-ada2-4a5a-8c67-52f77d4251a8 req-9558495e-df87-4452-bab7-c9c543eeb937 tempest-VolumesAdminNegativeTest-1107577532 tempest-VolumesAdminNegativeTest-1107577532-project-member] Enqueued Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 740.833512] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGHEST for action security_group_members [ 740.833966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.834114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.834182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.834406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.834589] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.834734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.834806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.835015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.835169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.835284] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.119148] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.119148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.119396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.119670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.119776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.120114] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.120188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.120323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.120463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.120540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.120687] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 741.158533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.158738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.158779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.159024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.159185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.172103] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 741.336948] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 741.336948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.337659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.337659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.337659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.337947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.337947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.338053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.338207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.338207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.338422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.338505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.338581] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 is going to be updated. [ 741.340685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.342217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.342217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.342217] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.342732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.343422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345761] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.346057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.346239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.346342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.346520] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.385772] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.385976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.385976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.386168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.386317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.404925] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: IN_PROGRESS for 2s [ 741.709106] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 741.710095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.848349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.848523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.849699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.352566] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.855889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.856591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.856591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.856591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.856591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857059] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 742.894772] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.894772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.894772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.894772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.894772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.908295] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 743.185189] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 743.185566] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 743.185884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417910] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 in Status: SUCCESS [ 743.418231] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 deletion is rescheduled due to dependency. [ 743.418294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.859402] env[65427]: INFO networking_nsxv3.common.synchronization [req-3fbdbef9-a14f-4c7d-b425-ff20889b30ce req-20f3e737-5fd4-462b-bf6a-8f8352e3ab16 tempest-VolumesAssistedSnapshotsTest-2048674847 tempest-VolumesAssistedSnapshotsTest-2048674847-project-member] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 744.859402] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGHEST for action security_group_members [ 744.859997] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.860622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.860828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.861121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.861557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.862880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.862880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.863418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.864030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.864030] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.919951] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 744.920262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.920453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.920718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.920935] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.921096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.921169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.921439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.921506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.921586] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.369358] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.369358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.369358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.369884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.369884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.370294] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.370389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.370459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.370814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.371144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.371318] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008bf551-bcd7-451b-8250-579db77bad7d is going to be updated. [ 745.403765] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.403924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.403993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.404296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.404381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.415086] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: IN_PROGRESS for 2s [ 745.424867] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.913615] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2910c6ff-ae76-4bb9-bd93-45baf8974c8f None None] Enqueued Resource ID: 2d24dbf8-b8f2-40ae-b157-f9aedff6951e with Priority: HIGHEST for action port [ 745.914195] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d24dbf8-b8f2-40ae-b157-f9aedff6951e with Priority: HIGHEST for action port [ 745.914510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d24dbf8-b8f2-40ae-b157-f9aedff6951e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.914665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d24dbf8-b8f2-40ae-b157-f9aedff6951e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.914739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d24dbf8-b8f2-40ae-b157-f9aedff6951e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.915163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d24dbf8-b8f2-40ae-b157-f9aedff6951e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.915251] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d24dbf8-b8f2-40ae-b157-f9aedff6951e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.927659] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.417543] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d24dbf8-b8f2-40ae-b157-f9aedff6951e [ 746.418025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.418025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.418232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.418331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.418445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.418571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d24dbf8-b8f2-40ae-b157-f9aedff6951e already deleted. [ 746.418665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d24dbf8-b8f2-40ae-b157-f9aedff6951e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.430332] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.430531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.430571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.430833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.430833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.430934] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 746.461936] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.462107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.462151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.462359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.462504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.474056] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 747.292429] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ed642c71-8d95-41b7-9559-6e1fbe20ffaf None None] Enqueued Resource ID: 24c3beaf-081b-4c07-ab5a-8c8bba732a78 with Priority: HIGHEST for action port [ 747.293043] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c3beaf-081b-4c07-ab5a-8c8bba732a78 with Priority: HIGHEST for action port [ 747.293389] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-24c3beaf-081b-4c07-ab5a-8c8bba732a78 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.293544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24c3beaf-081b-4c07-ab5a-8c8bba732a78" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.293618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24c3beaf-081b-4c07-ab5a-8c8bba732a78" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.293885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24c3beaf-081b-4c07-ab5a-8c8bba732a78" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.294031] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24c3beaf-081b-4c07-ab5a-8c8bba732a78',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.427350] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 008bf551-bcd7-451b-8250-579db77bad7d in Status: SUCCESS [ 747.427350] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 008bf551-bcd7-451b-8250-579db77bad7d deletion is rescheduled due to dependency. [ 747.427579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.659358] env[65427]: INFO networking_nsxv3.common.synchronization [None req-11044129-7ad8-4242-83cd-992609600f01 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 747.659617] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 747.660204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.660204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.660204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.662067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.662067] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.800585] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24c3beaf-081b-4c07-ab5a-8c8bba732a78 [ 747.801280] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.801280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.801280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.801567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.801567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.801567] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24c3beaf-081b-4c07-ab5a-8c8bba732a78 already deleted. [ 747.801735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24c3beaf-081b-4c07-ab5a-8c8bba732a78" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.847741] env[65427]: INFO networking_nsxv3.common.synchronization [None req-76ca8b95-f12c-4d2f-b3ca-83a2cff064bd tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 747.849409] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 747.849533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.849635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.183737] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.183882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.184014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.184211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.184308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.184747] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 already deleted. [ 748.184747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.184747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.185029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.185029] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.489061] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.489061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.490455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.490455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.490455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.490455] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.705105] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.705315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.705315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.705508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.705597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.705705] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 already deleted. [ 748.705826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.994965] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8bca44-f080-48fc-9d94-91ea357c71c7: rpc.has_security_group_logging(os_id): False [ 749.018848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.018848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.018848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.018848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.019490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.019490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.019490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.020195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.020472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.020716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be created. [ 749.115048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.115313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.115313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.117133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.117628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.134731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 749.356840] env[65427]: INFO networking_nsxv3.common.synchronization [None req-aaf7e998-9249-4968-98ac-30943b54a837 tempest-ServersTestJSON-485719575 tempest-ServersTestJSON-485719575-project-member] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 749.357433] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 749.357863] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.358250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.359136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.359136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.359136] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.498631] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c8cc29af-b4e4-4ea9-9d0d-6cc4840cbd03 tempest-ServersTestJSON-485719575 tempest-ServersTestJSON-485719575-project-member] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 749.499453] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 749.499772] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.499881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.884913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.885263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.885450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.885690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.885802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.885932] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 already deleted. [ 749.887388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.887627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.887901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.887942] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.956674] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b55f18bd-a582-4917-b5ad-6cf7c9dcf8a6 None None] Enqueued Resource ID: 035d6f06-8781-4080-b4ad-9707c5af6c2a with Priority: HIGHEST for action port [ 749.957624] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c08893f0-1f39-4a5d-b6dc-d009dd7e96b8 None None] Enqueued Resource ID: 2e53d207-8407-4275-97db-88bf0c65c9d7 with Priority: HIGHEST for action port [ 749.958272] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 035d6f06-8781-4080-b4ad-9707c5af6c2a with Priority: HIGHEST for action port [ 749.958413] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e53d207-8407-4275-97db-88bf0c65c9d7 with Priority: HIGHEST for action port [ 749.958707] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-035d6f06-8781-4080-b4ad-9707c5af6c2a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.959325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-035d6f06-8781-4080-b4ad-9707c5af6c2a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.959325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-035d6f06-8781-4080-b4ad-9707c5af6c2a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.959325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-035d6f06-8781-4080-b4ad-9707c5af6c2a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.959325] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('035d6f06-8781-4080-b4ad-9707c5af6c2a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.960169] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e53d207-8407-4275-97db-88bf0c65c9d7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.960278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e53d207-8407-4275-97db-88bf0c65c9d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.960347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e53d207-8407-4275-97db-88bf0c65c9d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.960619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e53d207-8407-4275-97db-88bf0c65c9d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.960685] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e53d207-8407-4275-97db-88bf0c65c9d7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.415210] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.415210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.415210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.415210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.415210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.415210] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 already deleted. [ 750.415210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.462843] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 035d6f06-8781-4080-b4ad-9707c5af6c2a [ 750.463100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.463529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.463801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.464067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.464172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.464273] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:035d6f06-8781-4080-b4ad-9707c5af6c2a already deleted. [ 750.464376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-035d6f06-8781-4080-b4ad-9707c5af6c2a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.464915] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e53d207-8407-4275-97db-88bf0c65c9d7 [ 750.465113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.465227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.465290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.465465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.465545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.465630] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e53d207-8407-4275-97db-88bf0c65c9d7 already deleted. [ 750.466035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e53d207-8407-4275-97db-88bf0c65c9d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.149490] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 751.149812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.149968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.150229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.150320] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.282040] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-f18208de-d2e3-447d-b801-eee7039959e9 tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 751.282040] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 751.282040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.282278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.282278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.282399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.282565] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.282685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.282874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.282923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.283023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.283081] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.633430] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.633745] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.633844] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.634513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.635936] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.635936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.635936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.635936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.635936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.635936] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.636610] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.636749] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.637358] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.637358] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.637553] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.637553] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.654754] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.654911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.656344] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.656495] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.656624] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.656849] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-761" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.657180] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.657356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.657451] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.657768] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.657891] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a16ba0c-cf4d-4739-be60-f587f8d88bdc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.785042] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.163531] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.163531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.163531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.163531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.163531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.164168] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 9a16ba0c-cf4d-4739-be60-f587f8d88bdc not found, creating... [ 752.164168] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.164295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.164380] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.164649] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.164788] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.165117] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.165277] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.165408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.165623] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.165845] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.166175] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 9a16ba0c-cf4d-4739-be60-f587f8d88bdc is going to be created. [ 752.186951] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.187333] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.187390] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.187708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.187945] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.188218] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.287734] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.789740] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.790143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.790143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.790309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.790379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.790463] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 752.821632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.821811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.821887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.822171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.822476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.834934] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 752.972967] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-d139b87f-dee2-429e-a78d-332c17b6187d service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 752.973144] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-d139b87f-dee2-429e-a78d-332c17b6187d service nova] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 752.973391] env[65427]: INFO networking_nsxv3.common.synchronization [req-cc7caf9b-5deb-4968-a119-9e8b5ef57bc3 req-d139b87f-dee2-429e-a78d-332c17b6187d service nova] Enqueued Resource ID: 9a16ba0c-cf4d-4739-be60-f587f8d88bdc with Priority: HIGHEST for action port [ 752.973674] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_rules [ 752.973809] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 752.973908] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a16ba0c-cf4d-4739-be60-f587f8d88bdc with Priority: HIGHEST for action port [ 752.974489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.974608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.974889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.974981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.975177] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.975281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.975347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.975551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.975633] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a16ba0c-cf4d-4739-be60-f587f8d88bdc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.478116] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a16ba0c-cf4d-4739-be60-f587f8d88bdc with status ACTIVE [ 753.478399] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.478521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.478589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.478811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.478918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.479095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.479206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.479648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.479648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.479648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.479781] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.479781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.479875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.479952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.480087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.480595] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a16ba0c-cf4d-4739-be60-f587f8d88bdc is going to be updated. [ 753.503310] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.506552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.506552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.506552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.506552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.506552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a16ba0c-cf4d-4739-be60-f587f8d88bdc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.847832] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 754.848140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.848244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.848448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.848644] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.849022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.849022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.849142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.849219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.849466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.849466] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.850223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.851506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.851506] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.851506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.851506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.851506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.851506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.851506] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.355152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.355152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.355152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.702088] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a9db8e7-6e80-455f-89b5-e69ded819c12 req-1befd05c-a091-4531-9a18-62eee46e13ec tempest-ServersV294TestFqdnHostnames-1061498094 tempest-ServersV294TestFqdnHostnames-1061498094-project-member] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 755.702088] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 755.702088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.702088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.702088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.702088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.702652] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.702905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.703091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.703371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.703613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.703826] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.857374] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.010484] env[65427]: INFO networking_nsxv3.common.synchronization [None req-be6d780d-d732-4f2c-a6f5-2a3ce5bb7cc2 None None] Enqueued Resource ID: d4ade2cc-0c84-4cfc-861e-3937b4b629bd with Priority: HIGHEST for action port [ 756.011165] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ade2cc-0c84-4cfc-861e-3937b4b629bd with Priority: HIGHEST for action port [ 756.011391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ade2cc-0c84-4cfc-861e-3937b4b629bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.011572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ade2cc-0c84-4cfc-861e-3937b4b629bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.011572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ade2cc-0c84-4cfc-861e-3937b4b629bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.011832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ade2cc-0c84-4cfc-861e-3937b4b629bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.011915] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ade2cc-0c84-4cfc-861e-3937b4b629bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.207456] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.207841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.209186] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.209186] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba already deleted. [ 756.209186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.349566] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.350911] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-409" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.350911] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-409" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.350911] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-409" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.350911] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.351349] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.354676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.354676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.354676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.354676] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.354676] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.354676] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.354676] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.354676] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.354676] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.354676] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.360419] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.360755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.362898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.362898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.362898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.362898] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 756.373334] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.373334] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.373600] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.373693] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-409" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.374018] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.374206] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.374322] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.374648] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.374776] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3532b6a1-ebff-43fa-b1e5-25013c7f8d47',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.392144] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.392330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.392404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.392557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.392703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.403081] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 756.514989] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4ade2cc-0c84-4cfc-861e-3937b4b629bd [ 756.515251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.515382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.515468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.515739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.515869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.516012] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4ade2cc-0c84-4cfc-861e-3937b4b629bd already deleted. [ 756.516086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ade2cc-0c84-4cfc-861e-3937b4b629bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.759430] env[65427]: INFO networking_nsxv3.common.synchronization [None req-27a34091-8e3c-462c-83f5-e7641e65b649 None None] Enqueued Resource ID: 9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba with Priority: HIGHEST for action port [ 756.760019] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba with Priority: HIGHEST for action port [ 756.760690] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.760690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.760690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.761090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.761090] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.877516] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.878090] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.878143] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.882096] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 not found, creating... [ 756.882096] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.882096] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.882096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.882669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.882669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.882669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.882669] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 is going to be created. [ 756.911559] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.911823] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.911893] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.912252] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.912496] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.912749] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.269023] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba [ 757.269294] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.269441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.269513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.269744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.269838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.269972] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba already deleted. [ 757.270024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d35a062-fa9f-4a4c-ad1c-b1631ea2cbba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.639724] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a9db8e7-6e80-455f-89b5-e69ded819c12 req-df9e0f17-5959-45a2-9385-27a85e76d8ce service nova] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 757.639959] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a9db8e7-6e80-455f-89b5-e69ded819c12 req-df9e0f17-5959-45a2-9385-27a85e76d8ce service nova] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 757.640108] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a9db8e7-6e80-455f-89b5-e69ded819c12 req-df9e0f17-5959-45a2-9385-27a85e76d8ce service nova] Enqueued Resource ID: 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 with Priority: HIGHEST for action port [ 757.644924] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_rules [ 757.644924] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 757.644924] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 with Priority: HIGHEST for action port [ 757.644924] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.644924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.644924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.644924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.644924] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.645312] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.645430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.645488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.645683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.646017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.646017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.646274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.646473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.646555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.648344] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.648344] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.648344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.648344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.648344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.648344] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3532b6a1-ebff-43fa-b1e5-25013c7f8d47',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.973212] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4888dc8e-34dc-420f-a097-f7b91011c89c None None] Enqueued Resource ID: 96839960-7327-44d1-8f41-6718f5fb5c58 with Priority: HIGHEST for action port [ 757.973448] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96839960-7327-44d1-8f41-6718f5fb5c58 with Priority: HIGHEST for action port [ 757.973960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-96839960-7327-44d1-8f41-6718f5fb5c58 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.973960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96839960-7327-44d1-8f41-6718f5fb5c58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.973960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96839960-7327-44d1-8f41-6718f5fb5c58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.974995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96839960-7327-44d1-8f41-6718f5fb5c58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.974995] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96839960-7327-44d1-8f41-6718f5fb5c58',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.002647] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecd61c67-ebe6-417d-8adb-e2339703a823 req-d2db54fb-b9bf-46c8-b1c0-a4a96dce2edd tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 758.003156] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 758.003413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.003760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.003760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.003912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.003971] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.004929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.004929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.004929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.004929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.004929] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.150237] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.153809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.153809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.153809] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 with status ACTIVE [ 758.153809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.153809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.153809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.153809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.153809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.153809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.154451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.154451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.154451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.154451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.154451] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.154451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.154651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.154651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.154706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.154749] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3532b6a1-ebff-43fa-b1e5-25013c7f8d47 is going to be updated. [ 758.180920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.181086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.181151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.181372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.181518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.181677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3532b6a1-ebff-43fa-b1e5-25013c7f8d47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.420318] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 758.420608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.420747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.421114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.421324] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.421442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.421595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.421688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.421881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.421881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.422030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.422147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.422193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.422333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.423402] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.423402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.423402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.423402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.423402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.423402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.423402] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.464098] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.464251] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.464251] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.464524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.464914] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.464914] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.465112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.465335] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.465469] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.465665] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.465767] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.465910] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.466038] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.466148] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.466252] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.466381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.475845] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96839960-7327-44d1-8f41-6718f5fb5c58 [ 758.476104] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.476472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.476472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.476549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.476634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.476733] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96839960-7327-44d1-8f41-6718f5fb5c58 already deleted. [ 758.476811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96839960-7327-44d1-8f41-6718f5fb5c58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.484946] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.485126] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.485257] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.485420] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.485771] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-9a3ce534-cdac-4090-b94a-6a72882b3f35 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.485989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.486119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.486459] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.486596] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a3ce534-cdac-4090-b94a-6a72882b3f35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.508383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.660107] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.932082] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8bca44-f080-48fc-9d94-91ea357c71c7: rpc.has_security_group_logging(os_id): False [ 758.950390] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.950587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.950627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.950864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.950963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.951212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.951316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.951380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.951615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.951704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.951886] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.951981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.952055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.952200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.952276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.952455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.952546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.952603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.952738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.952812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.952899] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 758.971681] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4b08becd-5647-4c53-a11f-0773f111df45 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 758.971741] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 758.972239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.972239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.972239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.972478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.972532] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.992028] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.992028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 9a3ce534-cdac-4090-b94a-6a72882b3f35 not found, creating... [ 758.992028] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.992028] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.992886] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.992886] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.993226] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.994251] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.994627] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.994935] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 9a3ce534-cdac-4090-b94a-6a72882b3f35 is going to be created. [ 759.012526] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.019758] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.019758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.019758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.019758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.019758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.019758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.028416] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.028775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.028905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.029163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.029500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.043791] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 759.139262] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9875df27-fa07-42f5-a4ec-99a35143d3b3 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 759.139262] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 759.139873] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.140126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.164562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.164562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.164562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.164562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.164562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.164921] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba is going to be created. [ 759.211171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.211472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.211472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.211628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.211840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.226300] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: UNINITIALIZED for 2s [ 759.496053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.498930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 already deleted. [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.498930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.498930] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.513904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.514099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.514159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.514377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.514467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.514612] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 759.554039] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.554039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.554039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.554039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.554039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.565245] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 759.616623] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5ebb0d78-f589-4992-bfff-d8e18ca5a448 None None] Enqueued Resource ID: a60beeab-4d46-44cd-a2a8-e29c0f782f5c with Priority: HIGHEST for action port [ 759.618033] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60beeab-4d46-44cd-a2a8-e29c0f782f5c with Priority: HIGHEST for action port [ 759.618033] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a60beeab-4d46-44cd-a2a8-e29c0f782f5c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.618033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a60beeab-4d46-44cd-a2a8-e29c0f782f5c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.618033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a60beeab-4d46-44cd-a2a8-e29c0f782f5c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.619161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a60beeab-4d46-44cd-a2a8-e29c0f782f5c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.619161] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60beeab-4d46-44cd-a2a8-e29c0f782f5c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.784019] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecd61c67-ebe6-417d-8adb-e2339703a823 req-c2c7f316-952a-40cd-ba7a-8713b13d443a service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 759.784153] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecd61c67-ebe6-417d-8adb-e2339703a823 req-c2c7f316-952a-40cd-ba7a-8713b13d443a service nova] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 759.784225] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecd61c67-ebe6-417d-8adb-e2339703a823 req-c2c7f316-952a-40cd-ba7a-8713b13d443a service nova] Enqueued Resource ID: 9a3ce534-cdac-4090-b94a-6a72882b3f35 with Priority: HIGHEST for action port [ 759.785230] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_rules [ 759.785446] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 759.785498] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a3ce534-cdac-4090-b94a-6a72882b3f35 with Priority: HIGHEST for action port [ 759.786212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.786212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.786212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.786212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.786528] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.790358] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.790358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.790358] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a3ce534-cdac-4090-b94a-6a72882b3f35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.790358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.790358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.790358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.790358] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a3ce534-cdac-4090-b94a-6a72882b3f35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.019403] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.019769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.019769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.019847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.019937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.020472] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 already deleted. [ 760.020472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.121571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a60beeab-4d46-44cd-a2a8-e29c0f782f5c [ 760.121900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.122748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.122748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.122938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.123015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.123015] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a60beeab-4d46-44cd-a2a8-e29c0f782f5c already deleted. [ 760.123015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a60beeab-4d46-44cd-a2a8-e29c0f782f5c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.291564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.291762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.292214] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a3ce534-cdac-4090-b94a-6a72882b3f35 with status ACTIVE [ 760.292517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.292612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.292665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.292868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.292957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.293181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.293324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.293389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.293502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.293668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.293827] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.294039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.294039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.294150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.294269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.294312] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a3ce534-cdac-4090-b94a-6a72882b3f35 is going to be updated. [ 760.317253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.317423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.317493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.317699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.317849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.318015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a3ce534-cdac-4090-b94a-6a72882b3f35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.061793] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 761.061793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.062363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.062363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.063606] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.238861] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: SUCCESS [ 761.239164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.239340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.240273] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.240273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.240273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.240273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.240273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.240273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.240511] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.566251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.566549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.566696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.567287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.567287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.567525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.567581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.567906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.568887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.568887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.568887] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.581347] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 761.581936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.582329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.583413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.583758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.583758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.583850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.583983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.584079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.584183] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.742831] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.072331] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.072663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.072663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.072849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.073129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.073349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.073349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.073457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.073644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.073803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.074068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.074068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.074554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.074554] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.074554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.074554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.074710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.074970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.074970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.074970] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.086914] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.245174] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af559c94-c3c8-4ec7-9d79-d7e3d84241ba: rpc.has_security_group_logging(os_id): False [ 762.267970] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.268136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.268318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.269203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.269570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.269872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.269979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.270056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.270238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.270328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.270418] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba is going to be created. [ 762.330977] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.331165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.331240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.331544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.331737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.345255] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: IN_PROGRESS for 2s [ 762.576976] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8bca44-f080-48fc-9d94-91ea357c71c7: rpc.has_security_group_logging(os_id): False [ 762.589993] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.597715] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.597715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.597715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.597996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.598055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.598282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.598401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.598451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.598608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.599867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.599867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.599867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.599867] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 762.680839] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.681121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.682019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.682019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.682019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.700398] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 763.094415] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.094415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.094415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.094415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.094415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.094415] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 763.130749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.130950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.131044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.131373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.131982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.148069] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 764.146309] env[65427]: INFO networking_nsxv3.common.synchronization [None req-e41dfbfc-c39c-4a13-ad13-69a12a8b982d None None] Enqueued Resource ID: 8cc0b50b-67a9-438b-a62e-ae07a0467f90 with Priority: HIGHEST for action port [ 764.146885] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc0b50b-67a9-438b-a62e-ae07a0467f90 with Priority: HIGHEST for action port [ 764.147250] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc0b50b-67a9-438b-a62e-ae07a0467f90 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.147390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc0b50b-67a9-438b-a62e-ae07a0467f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.147463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc0b50b-67a9-438b-a62e-ae07a0467f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.147743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc0b50b-67a9-438b-a62e-ae07a0467f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.147830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc0b50b-67a9-438b-a62e-ae07a0467f90',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.364552] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: SUCCESS [ 764.364791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.653024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cc0b50b-67a9-438b-a62e-ae07a0467f90 [ 764.653024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.653024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.653024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.653024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.653024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.653024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cc0b50b-67a9-438b-a62e-ae07a0467f90 already deleted. [ 764.653024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc0b50b-67a9-438b-a62e-ae07a0467f90" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.722760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 764.722978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.822023] env[65427]: INFO networking_nsxv3.common.synchronization [req-5722333f-f6c5-4ef3-83b8-c7fb265ec5cb req-5b9478f0-1993-441c-b487-75b9db8deed4 tempest-ServersAdminNegativeTestJSON-513132739 tempest-ServersAdminNegativeTestJSON-513132739-project-member] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 764.822023] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 764.822023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.822023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.822023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.822023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.822023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.822023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.822837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.823149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.823404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.823705] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.037934] env[65427]: INFO networking_nsxv3.common.synchronization [req-a6c9dc08-39fb-428c-8f72-6abb34a5f25c req-bc31dc61-70af-49ec-9444-8066aba4b337 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 765.038050] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 765.038405] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.038573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.038665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.038956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.039203] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.039318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.039489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.039534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.039614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.039711] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.119233] env[65427]: INFO networking_nsxv3.common.synchronization [None req-af83f5d5-c0af-40cd-b98c-ad0696c28cc8 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 765.120055] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 765.120512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.120702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.120837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.121343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.121461] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.161716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 765.162043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.162043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.162291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.162471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.162580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.162632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.162767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.162844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.162927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.163027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.256185] env[65427]: INFO networking_nsxv3.common.synchronization [None req-19fbd418-1b76-4a2c-85e7-867d157bf7ec tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 765.257162] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 765.257214] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.257296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.328517] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.484491] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.484955] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-927" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.484955] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-927" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.485212] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-927" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.485480] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.485696] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.485780] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.485951] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.486118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.486351] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.486435] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.486534] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.486638] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.486744] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.486846] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.486975] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.505997] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.506569] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 765.506727] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.506907] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-927" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.507242] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.507513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.507783] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.508136] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.508136] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.544349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.545302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.545302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.545302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.545302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.545302] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.545302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.545601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.545601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.545601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.545702] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a already deleted. [ 765.545761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.644861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.645148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.645148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.645494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.645494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.645829] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b already deleted. [ 765.645829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.645829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.646457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.646457] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.670738] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.671341] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.671441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.671504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.671827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.671915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.672090] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.672182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.672246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.672444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.672521] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.672613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.672698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.672841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.672915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.672997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.673102] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.834450] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.010879] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.011178] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.011338] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.011672] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.012111] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.012322] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 not found, creating... [ 766.012677] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.013017] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.013210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.013521] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.014533] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.014533] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.014533] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.014791] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.014889] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.015244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.015429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 is going to be created. [ 766.037963] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.037963] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.038115] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.038345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.038575] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.038885] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.042833] env[65427]: INFO networking_nsxv3.common.synchronization [req-99af4403-2c00-49cb-a4b2-88b6b272a854 req-9ccab9b7-6ea4-40fe-b075-c4df21978c44 tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 766.043760] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 766.044140] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.044302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.044397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.044624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.044831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.045228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.045336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.045548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.045672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.045789] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.172969] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.172969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.172969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.172969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.172969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.172969] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b already deleted. [ 766.172969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.176458] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f440566-de23-4d5d-b5b9-fdddf6cee691: rpc.has_security_group_logging(os_id): False [ 766.214022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.214022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.214022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.214022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.214773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.214996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.215173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.215416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.215589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.215760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 766.326354] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.326354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.326354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.326539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.326609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.335603] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.335603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.336742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.336742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.336742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.336910] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be updated. [ 766.352935] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 766.370301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.370301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.370301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.370497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.370800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.380949] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 766.548330] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.753200] env[65427]: INFO networking_nsxv3.common.synchronization [req-a6c9dc08-39fb-428c-8f72-6abb34a5f25c req-6e351942-7c23-4a0c-b460-ea8b11631c6c service nova] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 766.753402] env[65427]: INFO networking_nsxv3.common.synchronization [req-a6c9dc08-39fb-428c-8f72-6abb34a5f25c req-6e351942-7c23-4a0c-b460-ea8b11631c6c service nova] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 766.753541] env[65427]: INFO networking_nsxv3.common.synchronization [req-a6c9dc08-39fb-428c-8f72-6abb34a5f25c req-6e351942-7c23-4a0c-b460-ea8b11631c6c service nova] Enqueued Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 766.755107] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 766.755107] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 766.755107] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 766.755107] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.755107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.755107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.757189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.757330] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.758130] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.758261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.758338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.758518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.758688] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.758799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.758862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.759027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.759108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.759204] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.759978] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.760113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.760156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.760305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.760417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.956312] env[65427]: INFO networking_nsxv3.common.synchronization [None req-601c549b-182d-49a1-bb14-68a9eeba5ce7 None None] Enqueued Resource ID: f27dc77b-3b45-4fb5-a934-2d693596582f with Priority: HIGHEST for action port [ 766.958046] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27dc77b-3b45-4fb5-a934-2d693596582f with Priority: HIGHEST for action port [ 766.958153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27dc77b-3b45-4fb5-a934-2d693596582f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.958697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27dc77b-3b45-4fb5-a934-2d693596582f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.958917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27dc77b-3b45-4fb5-a934-2d693596582f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.959226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27dc77b-3b45-4fb5-a934-2d693596582f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.959293] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27dc77b-3b45-4fb5-a934-2d693596582f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.052993] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.263287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.263287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.263772] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.265853] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with status ACTIVE [ 767.265853] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.265853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.265853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.265853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.265853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.265853] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.266427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.266427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266572] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.266572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.266700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 is going to be updated. [ 767.269567] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.269726] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.315662] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.315851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.315944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.316255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.316436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.316637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.461950] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f27dc77b-3b45-4fb5-a934-2d693596582f [ 767.461950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.461950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.461950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.462382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.462382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.462382] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f27dc77b-3b45-4fb5-a934-2d693596582f already deleted. [ 767.462382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27dc77b-3b45-4fb5-a934-2d693596582f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.556932] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.557085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.557085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.557668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.557668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.557668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 767.587586] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.587586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.587586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.587586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.588192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.600213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 767.771100] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.275698] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.275698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.275698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.275698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.275698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.275698] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be created. [ 768.317455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.317673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.317770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.318279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.318279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.329449] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: UNINITIALIZED for 2s [ 768.367854] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 768.367854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.393075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 768.393294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.612271] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 769.612527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.339679] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 770.339911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.340093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.340311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.340499] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.340627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.340692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.340847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.340924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.341033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.341263] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.844607] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.845025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.845025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.845128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.845795] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.845953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.846035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.846192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.846284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.846366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.846531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.846615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.846687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.846841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.847034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.847121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.847190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.847333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.847412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.847494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.847585] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.349663] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f63122d-80d5-406e-9516-33dde99d684a: rpc.has_security_group_logging(os_id): False [ 771.376519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.376780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.376780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.377029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.377142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.377433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.377556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.377629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.377808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.377918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.378192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.378300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.378411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.378543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.378617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.378904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.379036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.379103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.379331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.379365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.380030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be created. [ 771.449649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.449783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.449849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.450074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.451279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.467416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 771.958433] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 771.958745] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 772.260507] env[65427]: INFO networking_nsxv3.common.synchronization [req-92e8f294-27fb-4aed-a6b5-34fc45f6ba50 req-737cb4d1-fa8d-4bc4-9272-01d021378ab2 tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 772.261284] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 772.261900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.263794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.263794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.263926] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.264287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.264287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.264447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.264534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.264598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.264970] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.632590] env[65427]: INFO networking_nsxv3.common.synchronization [req-5025dfc2-10c7-4bce-b436-c4907bd2366c req-e586a8fd-50cb-43de-a7c5-06f71417288a tempest-ListImageFiltersTestJSON-1692749154 tempest-ListImageFiltersTestJSON-1692749154-project-member] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 772.633210] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 772.633527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.633690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.633761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.633963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.634793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.635178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.635329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.636178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.636269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.636372] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.643383] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.643587] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.643750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.644064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.644322] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.644473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.644581] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.644792] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.644931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.645468] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.645552] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.646229] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.646229] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.646229] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.646229] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.646604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.669416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.669589] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.669762] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.669946] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.670321] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-e593800e-82d8-4465-9186-5d679c57d055 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.670513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.670631] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.670950] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.671093] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e593800e-82d8-4465-9186-5d679c57d055',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.766870] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.767134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.767134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.767329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.767422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.767626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.767755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.767899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.768161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.768297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.768297] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 772.793885] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.794210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.794210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.794313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.794454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.806925] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 773.139550] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.174218] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.174366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.174496] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.174853] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.175171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.175339] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port e593800e-82d8-4465-9186-5d679c57d055 not found, creating... [ 773.175609] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.175765] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.175877] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.176111] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.176255] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.176531] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.176678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.176789] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.176990] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.177242] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.177381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: e593800e-82d8-4465-9186-5d679c57d055 is going to be created. [ 773.199890] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.200123] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.200243] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.200513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.200739] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.200956] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.483324] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 773.483510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.642811] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.933146] env[65427]: INFO networking_nsxv3.common.synchronization [req-92e8f294-27fb-4aed-a6b5-34fc45f6ba50 req-283df694-bb5f-46ee-b736-ddf0cf1b7932 service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 773.933328] env[65427]: INFO networking_nsxv3.common.synchronization [req-92e8f294-27fb-4aed-a6b5-34fc45f6ba50 req-283df694-bb5f-46ee-b736-ddf0cf1b7932 service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 773.933507] env[65427]: INFO networking_nsxv3.common.synchronization [req-92e8f294-27fb-4aed-a6b5-34fc45f6ba50 req-283df694-bb5f-46ee-b736-ddf0cf1b7932 service nova] Enqueued Resource ID: e593800e-82d8-4465-9186-5d679c57d055 with Priority: HIGHEST for action port [ 773.934018] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 773.934160] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 773.934263] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e593800e-82d8-4465-9186-5d679c57d055 with Priority: HIGHEST for action port [ 773.937734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.937900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.937974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.938217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.938312] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.939587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.939702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.939915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e593800e-82d8-4465-9186-5d679c57d055 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.940036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.940104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.940295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.940375] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e593800e-82d8-4465-9186-5d679c57d055',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.145925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.146229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.146312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.146591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.146709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.146830] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 774.197071] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.197287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.197287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.197497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.197659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.207389] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 774.444831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.445100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.447741] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e593800e-82d8-4465-9186-5d679c57d055 with status ACTIVE [ 774.447976] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.448189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.448189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.449187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.449187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.449479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.449479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.449479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.449577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.449577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.449673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e593800e-82d8-4465-9186-5d679c57d055 is going to be updated. [ 774.479033] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.479206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.479206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.479792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.479792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.479792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e593800e-82d8-4465-9186-5d679c57d055" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.817042] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 774.817489] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f deletion is rescheduled due to dependency. [ 774.817614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.817780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.817999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.818212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.818329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.818402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.818550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.818631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.818723] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.322053] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.828265] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.218797] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 4s [ 776.331228] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.331580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.331580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.331697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.331902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.331902] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 776.368898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.369057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.369126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.369333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.369481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.379072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 776.984379] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4c9f6346-c1d2-4db8-9f41-459f276ad70c None None] Enqueued Resource ID: 6f8092bb-ae85-4a32-b436-305aa06e6fe7 with Priority: HIGHEST for action port [ 776.985392] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8092bb-ae85-4a32-b436-305aa06e6fe7 with Priority: HIGHEST for action port [ 776.986326] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f8092bb-ae85-4a32-b436-305aa06e6fe7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.986802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f8092bb-ae85-4a32-b436-305aa06e6fe7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.986922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f8092bb-ae85-4a32-b436-305aa06e6fe7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.987290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f8092bb-ae85-4a32-b436-305aa06e6fe7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.987436] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f8092bb-ae85-4a32-b436-305aa06e6fe7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.491547] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f8092bb-ae85-4a32-b436-305aa06e6fe7 [ 777.491547] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.491547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.491547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.491939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.491939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.491939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f8092bb-ae85-4a32-b436-305aa06e6fe7 already deleted. [ 777.492050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f8092bb-ae85-4a32-b436-305aa06e6fe7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.597169] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9744ccc-3454-4659-9f7a-efcf583b50e3 req-622d78cc-926e-4c13-a0f5-f2f8acb17d47 tempest-ServerActionsV293TestJSON-1237020817 tempest-ServerActionsV293TestJSON-1237020817-project-member] Enqueued Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 777.597727] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf with Priority: HIGHEST for action security_group_members [ 777.598160] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.598334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.598428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.599244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.599424] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.599530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.599590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.599750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.599839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.599958] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.103430] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.106940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.106940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.106940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf is going to be updated. [ 778.138413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.138578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.138658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.138878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.139090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.149656] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: IN_PROGRESS for 2s [ 778.229469] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 778.230990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.389442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 778.389670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.389830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.390251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.390368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.390512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.390756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.390861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.390965] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.800215] env[65427]: INFO networking_nsxv3.common.synchronization [req-e2556e8e-ab2d-4c38-abf6-c1ff1ab86f09 req-2f865555-4664-4054-a64e-6c5f993a54c7 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 778.800505] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 778.800663] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.800958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.800958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.801144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.801325] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.801414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.801473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.801750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.801934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.802043] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.898024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.898024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.898024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.898024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.898024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.898680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.898680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.898680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.898680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.898680] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.219691] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.220828] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.220828] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.220828] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.221594] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.221919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.222166] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.222538] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.222772] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.223120] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.223335] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.223526] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.223720] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.223917] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.224253] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.224476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.247746] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.248214] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.248214] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.248453] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.249361] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-94e5f146-ffb7-430c-af9c-8140961edf47 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.249361] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.249361] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.250183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.253023] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e5f146-ffb7-430c-af9c-8140961edf47',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.306078] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.331766] env[65427]: INFO networking_nsxv3.common.synchronization [None req-d05c2d29-baf3-43c9-b876-1b9d242b3924 None None] Enqueued Resource ID: e191e2d5-f5ab-4254-8f85-c13fd47537c9 with Priority: HIGHEST for action port [ 779.332442] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e191e2d5-f5ab-4254-8f85-c13fd47537c9 with Priority: HIGHEST for action port [ 779.332776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e191e2d5-f5ab-4254-8f85-c13fd47537c9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.332907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e191e2d5-f5ab-4254-8f85-c13fd47537c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.332977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e191e2d5-f5ab-4254-8f85-c13fd47537c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.333364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e191e2d5-f5ab-4254-8f85-c13fd47537c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.333415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e191e2d5-f5ab-4254-8f85-c13fd47537c9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.409641] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc0cbb36-d62c-40ce-9e79-61f04e36627f: rpc.has_security_group_logging(os_id): False [ 779.434291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.434291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.434291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.434475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.434796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.434904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.435968] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.435968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.436734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.436734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.436734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.436734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.436734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.437015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.437015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.437132] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 779.532052] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.532052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.532366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.532366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.532769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.550919] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 779.755334] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.755825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.755825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.756217] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.756319] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.756499] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 94e5f146-ffb7-430c-af9c-8140961edf47 not found, creating... [ 779.756865] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.757598] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.757723] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.757977] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.758129] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.758534] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.758741] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.758863] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.759082] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.759262] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.759541] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 94e5f146-ffb7-430c-af9c-8140961edf47 is going to be created. [ 779.788843] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.789190] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.789344] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.789606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.789832] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.790357] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.809108] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.835846] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e191e2d5-f5ab-4254-8f85-c13fd47537c9 [ 779.836116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.836247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.836319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.836529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.836618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.836729] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e191e2d5-f5ab-4254-8f85-c13fd47537c9 already deleted. [ 779.836787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e191e2d5-f5ab-4254-8f85-c13fd47537c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.160432] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf in Status: SUCCESS [ 780.160575] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf deletion is rescheduled due to dependency. [ 780.160619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.312471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.312643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.312643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.312869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.313172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.313172] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 780.348751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.348751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.348751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.348751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.348924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.358120] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 780.501784] env[65427]: INFO networking_nsxv3.common.synchronization [req-e2556e8e-ab2d-4c38-abf6-c1ff1ab86f09 req-0466bcc8-a68d-4878-b111-ee5c362ffb70 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 780.501984] env[65427]: INFO networking_nsxv3.common.synchronization [req-e2556e8e-ab2d-4c38-abf6-c1ff1ab86f09 req-0466bcc8-a68d-4878-b111-ee5c362ffb70 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 780.502192] env[65427]: INFO networking_nsxv3.common.synchronization [req-e2556e8e-ab2d-4c38-abf6-c1ff1ab86f09 req-0466bcc8-a68d-4878-b111-ee5c362ffb70 service nova] Enqueued Resource ID: 94e5f146-ffb7-430c-af9c-8140961edf47 with Priority: HIGHEST for action port [ 780.502761] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 780.502848] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 780.502943] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e5f146-ffb7-430c-af9c-8140961edf47 with Priority: HIGHEST for action port [ 780.503897] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.504323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.504422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.504648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.504767] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.505670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.505757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.505953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e5f146-ffb7-430c-af9c-8140961edf47 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.506198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.506198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.506305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.506361] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e5f146-ffb7-430c-af9c-8140961edf47',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.008212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.008582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.008646] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94e5f146-ffb7-430c-af9c-8140961edf47 with status ACTIVE [ 781.008817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.008927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.008996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.009272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.009373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.009631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.009761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.009856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.010095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.010193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.010448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.010639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.010639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.010806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.010915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.011033] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94e5f146-ffb7-430c-af9c-8140961edf47 is going to be updated. [ 781.046241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.046241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.046241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.047212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.047212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.047212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e5f146-ffb7-430c-af9c-8140961edf47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.561876] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 781.562208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.375241] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.375241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.375241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.375983] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.882058] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.142162] env[65427]: INFO networking_nsxv3.common.synchronization [req-75d3e551-c708-40e1-9d3c-acdac2e80d65 req-c89bbaf8-0eb4-43d0-b196-94ff54131e46 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 783.142821] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 783.144145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.144297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.145707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.146061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.146290] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.146508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.146597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.147046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.147152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.147264] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.387055] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.527555] env[65427]: INFO networking_nsxv3.common.synchronization [None req-77c54857-c5eb-4546-b9b4-0e4c25aa4cc5 None None] Enqueued Resource ID: 53249f43-cdf7-4012-beb3-1b37c86958ae with Priority: HIGHEST for action port [ 783.528182] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53249f43-cdf7-4012-beb3-1b37c86958ae with Priority: HIGHEST for action port [ 783.528489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-53249f43-cdf7-4012-beb3-1b37c86958ae taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.528603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53249f43-cdf7-4012-beb3-1b37c86958ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.529075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53249f43-cdf7-4012-beb3-1b37c86958ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.529358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53249f43-cdf7-4012-beb3-1b37c86958ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.529441] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53249f43-cdf7-4012-beb3-1b37c86958ae',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.540192] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.540375] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.540721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.540843] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.541039] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.541279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.541374] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.541504] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.541660] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.541863] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.541969] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.542083] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.542186] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.542399] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.542466] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.542529] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.564469] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.564680] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.564877] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.565186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.565622] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-815486f0-92c9-4599-83fd-da8c97cc0d7b taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.565622] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.565797] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.565993] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.566278] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815486f0-92c9-4599-83fd-da8c97cc0d7b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.650500] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.650906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.650906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.651139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.651227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.651442] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.651556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.651615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.651774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.651851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.652313] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 already deleted. [ 783.652313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.890407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.890583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.890627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.890834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.890921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.891027] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 783.920616] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.920768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.920840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.921073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.921442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.932192] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 784.032119] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53249f43-cdf7-4012-beb3-1b37c86958ae [ 784.032363] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.032518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.032563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.032815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.032905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.032958] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53249f43-cdf7-4012-beb3-1b37c86958ae already deleted. [ 784.033111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53249f43-cdf7-4012-beb3-1b37c86958ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.068337] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.068637] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.068809] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.069170] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.069376] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.069573] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 815486f0-92c9-4599-83fd-da8c97cc0d7b not found, creating... [ 784.069904] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.070155] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.070289] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.070557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.070701] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.070992] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.071789] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.071910] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.072547] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.072686] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.072828] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b is going to be created. [ 784.097513] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.097975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.097975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.098460] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.098460] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.098653] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842183] env[65427]: INFO networking_nsxv3.common.synchronization [req-75d3e551-c708-40e1-9d3c-acdac2e80d65 req-8c77fd24-1445-45bc-b4cf-84fcfb8de9f1 service nova] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 784.842183] env[65427]: INFO networking_nsxv3.common.synchronization [req-75d3e551-c708-40e1-9d3c-acdac2e80d65 req-8c77fd24-1445-45bc-b4cf-84fcfb8de9f1 service nova] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 784.842459] env[65427]: INFO networking_nsxv3.common.synchronization [req-75d3e551-c708-40e1-9d3c-acdac2e80d65 req-8c77fd24-1445-45bc-b4cf-84fcfb8de9f1 service nova] Enqueued Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 784.847217] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 784.847217] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 784.847217] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 784.847217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.847217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.847568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.847568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.847638] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.848971] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.849094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.849160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.849331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.849474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.849564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.849624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.850021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.850021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.850021] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.851865] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-815486f0-92c9-4599-83fd-da8c97cc0d7b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.851978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.853307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.853307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.853307] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815486f0-92c9-4599-83fd-da8c97cc0d7b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.353294] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.358028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 815486f0-92c9-4599-83fd-da8c97cc0d7b with status ACTIVE [ 785.358028] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.358028] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.358028] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.358028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.358028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b is going to be updated. [ 785.361189] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.361189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.387265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.387527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.387645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.387850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.388091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.388221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.863094] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.945577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 785.945797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.946828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.946828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.946828] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.946828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.946828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.946828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.947103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.947103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.947103] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.365289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.365514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.365609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.365855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.365973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.366134] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be created. [ 786.389293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.389461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.389543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.389767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.389975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.400244] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: UNINITIALIZED for 2s [ 786.450779] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.451017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.451017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.451444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.451645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.451778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.451852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.452052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.452612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.452612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.452612] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.452612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.452612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.452948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.453000] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.453154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.453154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.453353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.453353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.453527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.453527] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.957038] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 786.962407] env[65427]: INFO networking_nsxv3.common.synchronization [None req-db774744-0a33-485d-9bcc-806d9eca8ebc None None] Enqueued Resource ID: 53f5a60e-5692-44ff-957f-8cd61c0d6d02 with Priority: HIGHEST for action port [ 786.962969] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53f5a60e-5692-44ff-957f-8cd61c0d6d02 with Priority: HIGHEST for action port [ 786.963282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-53f5a60e-5692-44ff-957f-8cd61c0d6d02 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.963398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53f5a60e-5692-44ff-957f-8cd61c0d6d02" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.963527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53f5a60e-5692-44ff-957f-8cd61c0d6d02" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.963763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53f5a60e-5692-44ff-957f-8cd61c0d6d02" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.963819] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f5a60e-5692-44ff-957f-8cd61c0d6d02',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.974881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.974881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.975130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.975275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.976260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.976260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.976260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.976260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.976260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.976627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.976627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.976758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.976758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.976872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.977514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.977514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.977514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.977514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.977514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.977514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.977980] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 787.046390] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.046530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.046595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.046861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.046957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.060192] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 787.376230] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 787.377492] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 787.377492] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 787.377492] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 787.377746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.377746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.377746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.378065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.378323] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.378445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.379492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.379492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.379492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.379492] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.379666] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b38469a-ac31-4bd0-a816-52080b580c35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.379774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.379843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.380198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.380292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.380353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.380770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380863] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.431232] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_rules [ 787.431816] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 787.432399] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 787.432399] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 787.432399] env[65427]: INFO networking_nsxv3.common.synchronization [req-58b24335-24a8-42be-95f0-b106c54c8883 req-7aa8f59a-6d5d-4bbb-a5d8-b4f74af78ea7 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 787.432865] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_rules [ 787.433011] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 787.433136] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 787.433229] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 787.433316] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 787.433580] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b38469a-ac31-4bd0-a816-52080b580c35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.433700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.433831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.434103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.434190] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.435284] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.435374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.436105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.436105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.436105] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.436833] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.436961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.437077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.437349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.437457] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.438377] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b38469a-ac31-4bd0-a816-52080b580c35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.438377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.438565] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.438648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.467897] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53f5a60e-5692-44ff-957f-8cd61c0d6d02 [ 787.468174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.468316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.468636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.468856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.468944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.469750] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53f5a60e-5692-44ff-957f-8cd61c0d6d02 already deleted. [ 787.469750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53f5a60e-5692-44ff-957f-8cd61c0d6d02" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.882673] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.883553] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.940123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.940123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.940497] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b38469a-ac31-4bd0-a816-52080b580c35 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.940632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.941965] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with status ACTIVE [ 787.942141] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.942285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.942365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.942571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.942660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.942835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.942935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.942998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.943167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.943244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.943423] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.943518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.943580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.943769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.943812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.944336] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 is going to be updated. [ 787.967398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.967754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.967754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.967754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.967868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.172775] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecc0911a-e61b-4496-a12b-96b0fbc917da req-fba20e09-9d77-4047-9dd1-e25f4ff10006 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 788.172775] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecc0911a-e61b-4496-a12b-96b0fbc917da req-fba20e09-9d77-4047-9dd1-e25f4ff10006 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 788.172969] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 788.173512] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b38469a-ac31-4bd0-a816-52080b580c35 with Priority: HIGHEST for action security_group_members [ 788.173512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.173512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.173692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b38469a-ac31-4bd0-a816-52080b580c35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.173692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.226396] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecc0911a-e61b-4496-a12b-96b0fbc917da req-fba20e09-9d77-4047-9dd1-e25f4ff10006 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 788.226396] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecc0911a-e61b-4496-a12b-96b0fbc917da req-fba20e09-9d77-4047-9dd1-e25f4ff10006 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 788.226554] env[65427]: INFO networking_nsxv3.common.synchronization [req-ecc0911a-e61b-4496-a12b-96b0fbc917da req-fba20e09-9d77-4047-9dd1-e25f4ff10006 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 788.227292] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_rules [ 788.227446] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 788.227533] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with Priority: HIGHEST for action port [ 788.227857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.227991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.228231] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.228319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.228526] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.228649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.228729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.228916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.230124] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.385707] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.388026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.416057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 788.416057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.416057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.416057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.416057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.416057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.416057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.416345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.416345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.416345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.416433] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.733059] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 with status ACTIVE [ 788.733269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.733349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.733393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.733623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.734097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.734097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.734233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.734233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.734471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.734574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.734801] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.735093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.735145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.735364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.735494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.735646] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91 is going to be updated. [ 788.762485] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.762485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.762485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.762485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.762781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.762838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cfecf1c-d6bf-4ef0-b9a9-e7e3db63ce91" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.891608] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.891847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.891931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.892864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.893028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.893171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 788.896238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.896382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.896454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.896685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.896818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.896914] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 is going to be created. [ 788.923261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.923261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.923261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.923261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.923261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.924189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.924189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.924189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.924189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.924189] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.944217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.944425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.944425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.944719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.944900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.947756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.947923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.948132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.948353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.948512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.960903] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 788.962145] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b38469a-ac31-4bd0-a816-52080b580c35 in Status: UNINITIALIZED for 2s [ 789.075866] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 789.076424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.427419] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 789.446830] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.447017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.447128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.447463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.447798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.448168] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.449075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.449173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.449388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.450541] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.450541] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.450541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.450874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.450874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.450874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.451086] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be created. [ 789.517374] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.518270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.518270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.518270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.520512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.530701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 789.922976] env[65427]: INFO networking_nsxv3.common.synchronization [req-33bb682a-27c3-4723-9a6b-699e1ac65f44 req-018e0862-12e9-453d-b840-e993e7b1404a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 789.923574] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 789.923961] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.924414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.924503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.924683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.924872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.925019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.925083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.925240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.925321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.925416] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.954594] env[65427]: INFO networking_nsxv3.common.synchronization [req-33bb682a-27c3-4723-9a6b-699e1ac65f44 req-018e0862-12e9-453d-b840-e993e7b1404a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 789.954803] env[65427]: INFO networking_nsxv3.common.synchronization [req-33bb682a-27c3-4723-9a6b-699e1ac65f44 req-018e0862-12e9-453d-b840-e993e7b1404a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 789.955017] env[65427]: INFO networking_nsxv3.common.synchronization [req-33bb682a-27c3-4723-9a6b-699e1ac65f44 req-018e0862-12e9-453d-b840-e993e7b1404a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 789.955723] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 789.956211] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 789.956602] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 789.956936] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.957181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.957282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.957530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.957661] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.959337] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.960302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.960302] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde07091-d397-473a-96d2-9ac0b1352702 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.960302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.960302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.960302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.960567] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde07091-d397-473a-96d2-9ac0b1352702',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.429403] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.462975] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde07091-d397-473a-96d2-9ac0b1352702 with status ACTIVE [ 790.462975] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.462975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.463190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.464164] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.464164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.464529] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.464529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.464529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.464680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.464680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.464776] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde07091-d397-473a-96d2-9ac0b1352702 is going to be updated. [ 790.466105] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.466105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.490806] env[65427]: INFO networking_nsxv3.common.synchronization [req-aa2707e6-c44c-4b82-b339-4f9895a7d7c0 req-168dd7ae-c3fe-4f99-ad8b-caa4f854c65e tempest-ServersTestManualDisk-660276821 tempest-ServersTestManualDisk-660276821-project-member] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 790.492117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.492514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.492644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.492941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.493131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.493361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.494773] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGHEST for action security_group_members [ 790.494966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.495112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.495183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.495374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.495533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.495631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.495695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.495842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.495949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.496066] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.932843] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.973422] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 790.973695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.973967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.974469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.974559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.974666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.974776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.974975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.975227] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.977828] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b38469a-ac31-4bd0-a816-52080b580c35 in Status: SUCCESS [ 790.978298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.979164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.979647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.979746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.979950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.980097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.980634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.980777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.980950] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.999662] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.999999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.999999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.000082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.001025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.001025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.001025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.001025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.001025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.001025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.001025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e is going to be updated. [ 791.082925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.082925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.082925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.083236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.083334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.105444] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: IN_PROGRESS for 2s [ 791.257744] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9aa6a58-b0f0-44b1-93ef-74a0eff7b4a6 req-52a5a6fc-781b-4548-87c8-53a467947f3b tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 791.259685] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 791.262408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.262408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.262408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.262408] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.438099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.438403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.438403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.438526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.438683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.438862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 791.469610] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.469756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.470319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.470558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.470710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.482282] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 791.482671] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.483906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.484034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.484150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.484302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.484382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.484919] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.484919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.484919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.486838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.486838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.486838] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 is going to be deleted. [ 791.522885] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.524938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.525065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.525321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.525424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.525532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.526190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.526392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.527245] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.527245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.527245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.527245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.527245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.530308] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.549929] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 791.549929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.767431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.767864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.768030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.768378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.768517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.768892] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.769081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.769218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.769462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.769596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.769772] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc already deleted. [ 791.770414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.792238] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.792238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.792352] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.792966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.793916] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.794199] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.794381] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.794809] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.795044] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.795322] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.795781] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.795781] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.795958] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.796457] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.796635] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.797128] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.820726] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.820953] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.821126] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.821386] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.821632] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-e99878c4-8cd3-46be-9d69-ab22389e10e6 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.822665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.822665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.822665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.822665] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99878c4-8cd3-46be-9d69-ab22389e10e6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.987069] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.035709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.035912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.035958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.036187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.036280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.036557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.036702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.036802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.036944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.037038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.037126] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 already deleted. [ 792.037208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.037313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.038562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.038743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.038918] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.039038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.039122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.039247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.039355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.039440] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.325272] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.325617] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.325659] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.325936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.326122] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.326295] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port e99878c4-8cd3-46be-9d69-ab22389e10e6 not found, creating... [ 792.326608] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.326801] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.326919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.327199] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.327337] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.327666] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.327859] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.327910] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.328110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.328273] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.328437] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: e99878c4-8cd3-46be-9d69-ab22389e10e6 is going to be created. [ 792.352685] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.352935] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.353036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.353353] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.353588] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.353929] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.489638] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.489943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.489943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.490122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.490216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.490358] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 792.521625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.521862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.522262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.522262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.522388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.531942] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 792.540845] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b38469a-ac31-4bd0-a816-52080b580c35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.542387] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.543133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.543133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.543133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.543133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.543133] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.543531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.543531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.543531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.543531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.543531] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 already deleted. [ 792.543787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.038211] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9aa6a58-b0f0-44b1-93ef-74a0eff7b4a6 req-b52570e7-3459-4411-a00b-1f8a07c5e330 service nova] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 793.038329] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9aa6a58-b0f0-44b1-93ef-74a0eff7b4a6 req-b52570e7-3459-4411-a00b-1f8a07c5e330 service nova] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 793.038457] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9aa6a58-b0f0-44b1-93ef-74a0eff7b4a6 req-b52570e7-3459-4411-a00b-1f8a07c5e330 service nova] Enqueued Resource ID: e99878c4-8cd3-46be-9d69-ab22389e10e6 with Priority: HIGHEST for action port [ 793.038683] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_rules [ 793.038818] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 793.038916] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99878c4-8cd3-46be-9d69-ab22389e10e6 with Priority: HIGHEST for action port [ 793.039496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.039613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.039683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.039935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.039996] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.042173] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.042299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.042369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.042601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.042814] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.042922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.042977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.043638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.043638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.043638] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.045079] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e99878c4-8cd3-46be-9d69-ab22389e10e6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.045191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.045261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.045426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.045507] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99878c4-8cd3-46be-9d69-ab22389e10e6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.049342] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b38469a-ac31-4bd0-a816-52080b580c35: rpc.has_security_group_logging(os_id): False [ 793.068628] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.068826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.068826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.069051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.069140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.069357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.069451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.069509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.069654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.069727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.069810] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 is going to be created. [ 793.092088] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35], does not exist path=[/infra/domains/default/groups/1b38469a-ac31-4bd0-a816-52080b580c35]."\n}' [ 793.092403] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35 [ 793.092547] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 793.115651] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e in Status: SUCCESS [ 793.115887] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e deletion is rescheduled due to dependency. [ 793.115999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.142962] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.143212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.143287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.143510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.144799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.145241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.145372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.145453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.145945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.145945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.145945] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.146127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.146127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.146241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.146316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.146412] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b38469a-ac31-4bd0-a816-52080b580c35 is going to be created. [ 793.167759] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35], does not exist path=[/infra/domains/default/groups/1b38469a-ac31-4bd0-a816-52080b580c35]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35 [ 793.167946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b38469a-ac31-4bd0-a816-52080b580c35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.168565] env[65427]: Traceback (most recent call last): [ 793.168565] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 793.168565] env[65427]: return func(*args, **kwargs) [ 793.168565] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 793.168565] env[65427]: res.raise_for_status() [ 793.168565] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 793.168565] env[65427]: raise HTTPError(http_error_msg, response=self) [ 793.168915] env[65427]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35 [ 793.168915] env[65427]: During handling of the above exception, another exception occurred: [ 793.168915] env[65427]: Traceback (most recent call last): [ 793.168915] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 793.168915] env[65427]: listener.cb(fileno) [ 793.168915] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 793.168915] env[65427]: result = function(*args, **kwargs) [ 793.168915] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 793.168915] env[65427]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 793.168915] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 793.168915] env[65427]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 793.168915] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 793.168915] env[65427]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 793.168915] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 793.168915] env[65427]: res.raise_for_status() [ 793.168915] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 793.168915] env[65427]: raise HTTPError(http_error_msg, response=self) [ 793.168915] env[65427]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b38469a-ac31-4bd0-a816-52080b580c35 [ 793.168915] env[65427]: Removing descriptor: 19 [ 793.495226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 793.495501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.495631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.495848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.496242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.496396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.496580] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.547569] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.548844] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.549663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.551078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e99878c4-8cd3-46be-9d69-ab22389e10e6 with status ACTIVE [ 793.552726] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.553028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.555114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.555114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.555114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.557213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.557213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.557213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.557213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e99878c4-8cd3-46be-9d69-ab22389e10e6 is going to be updated. [ 793.582660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.585189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.585189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.585189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.585189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.585189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e99878c4-8cd3-46be-9d69-ab22389e10e6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.999669] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.051992] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.215593] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.215593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.215593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.215593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.215593] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.504956] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.542347] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 794.542576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.542787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.542964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.543184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.543939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.543939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.543939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.543939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.543939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.543939] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.544805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.545856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.545856] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.545856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.545856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.545856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.545856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.545856] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.557490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.557616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.557695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.557992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.558103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.558340] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc is going to be created. [ 794.583963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.584128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.584197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.584403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.584558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.595701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: UNINITIALIZED for 2s [ 794.716762] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.007347] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.007550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.007620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.007827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.008348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.008348] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 795.042887] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.043088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.043179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.043423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.043576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.047483] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.047675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.047987] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.058894] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 795.221149] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.552250] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.723070] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 795.723172] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 796.058825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.058972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.059024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.059227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.059322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.059421] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 796.092213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.092213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.092213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.092213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.092213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.105438] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 796.396091] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 796.396304] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 796.396880] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 796.399488] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 796.399488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.399488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.399488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.400672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.400672] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.400672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.400672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.400672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.400672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.400672] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.402454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.402454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.402622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.402770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.402996] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.403140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.403176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.405200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.405200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.405200] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.470471] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 796.470654] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 796.470782] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_rules [ 796.470908] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 796.471096] env[65427]: INFO networking_nsxv3.common.synchronization [req-5fe37d60-c5ee-42d2-a303-81cae9156ca1 req-2a72279e-5faf-4a3b-a06f-ba9251b73ce7 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 796.471712] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 796.472093] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_rules [ 796.472093] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 796.472093] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 796.472254] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 796.473070] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.473070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.473070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.473369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.473369] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.475182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.475312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.475385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.475630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.475714] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.476646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-815486f0-92c9-4599-83fd-da8c97cc0d7b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.476767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.476834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.477079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.477079] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815486f0-92c9-4599-83fd-da8c97cc0d7b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.479309] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.479309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.479309] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.479309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.611544] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: SUCCESS [ 796.612013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.613222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.613621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.613923] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.617382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.617382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.617382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.617382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.617382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.617382] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.828029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.828029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.828029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.828289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.842865] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 796.844102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.845252] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 796.877446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.877648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.877681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.877961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.885322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.885671] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 796.885753] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 796.885841] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 796.905561] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.907268] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.929791] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.929976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.930100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.931482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.931482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.931482] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 796.981432] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.981432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.981432] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.981432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.981432] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 815486f0-92c9-4599-83fd-da8c97cc0d7b with status ACTIVE [ 796.981831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.982123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.982594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.982594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.982594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.983026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.983026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.983026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.983195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.983195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.983319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.983407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.983758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.983758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.983758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.984058] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b is going to be updated. [ 797.000380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.000543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.000600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.000811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.001042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.001257] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 797.008879] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.009030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.009102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.009315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.009451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.009605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.069405] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 797.069803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.069803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.070304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070572] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.070706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.070792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.070951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.071049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071261] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.119529] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.125444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.125591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.125673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.125889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.126103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.126631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 797.126746] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc0cbb36-d62c-40ce-9e79-61f04e36627f', '89734b51-576f-441c-a85a-6861eb7a5b94', '03d7ed4a-3466-430c-b324-25493c8ea5f4', 'edd2e5f2-2b98-4da6-a58d-0f7cac660a06', 'dbe90e39-abbd-4d07-9021-eedecd7a9539', '529af775-9e29-4633-b5c4-0f3bcc0e524d', 'efd36953-3031-481f-ae25-8e10517a449e', '7d911c02-2fb8-4b8a-94ab-e744e4a812ee', 'ef110958-8d53-4daf-a376-677eb87ffe7f', 'e08d6a87-c5be-4f46-9078-9a60601143bd', 'bfc5b74e-b81a-42f3-a700-31dc0eae6488', '1bdf134a-d29c-4b39-8d6f-906721fa578b', '008bf551-bcd7-451b-8250-579db77bad7d', '7abbe624-4b85-4277-bdd0-ed749e166fc9', 'f7c8992c-2da4-43aa-a91a-0a4902c45817', '2c8bca44-f080-48fc-9d94-91ea357c71c7', '06cf1e57-ae2c-4617-80cf-281da56f6c6e', 'e987c094-a21a-43f5-a474-5ed1b1a855b6', '2f440566-de23-4d5d-b5b9-fdddf6cee691', '69f47490-5211-4c8e-9e0a-b7d44c25960f', '2caa26d9-b324-42d2-886a-42215d3c4faf', '9f63122d-80d5-406e-9516-33dde99d684a', 'af559c94-c3c8-4ec7-9d79-d7e3d84241ba', '974a55e0-fc07-407b-9d34-07e598ec3f15', '54fe1b7a-483b-4522-ab83-ced21005a9ad', '5de73072-1420-4348-9a8f-7aea1d3f3f89', 'e055f6e8-5bdf-4d73-ac15-366894643fcc', '170e7804-bd59-4b8d-a494-3a73bf406102', '584eb45a-7106-4759-8924-ff61fcdd399f', 'c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf', 'a8dbec4d-8461-4cc1-9978-3a0a69ea030c'} {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.126849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 797.161920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.164930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.164930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.164930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.164930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.164930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 797.164930] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.164930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 797.265443] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.265443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.265443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.265443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.266674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.266674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 797.266674] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.266674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 797.266674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 797.266674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 797.266674] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGH for action security_group_rules [ 797.267265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGH for action security_group_rules [ 797.267265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGH for action security_group_rules [ 797.267265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGH for action security_group_rules [ 797.267265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGH for action security_group_rules [ 797.267265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGH for action security_group_rules [ 797.267541] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGH for action security_group_rules [ 797.267541] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGH for action security_group_rules [ 797.267670] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGH for action security_group_rules [ 797.267773] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGH for action security_group_rules [ 797.267850] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGH for action security_group_rules [ 797.267950] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 797.268090] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGH for action security_group_rules [ 797.268207] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGH for action security_group_rules [ 797.268326] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGH for action security_group_rules [ 797.268463] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGH for action security_group_rules [ 797.268582] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGH for action security_group_rules [ 797.268707] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGH for action security_group_rules [ 797.268838] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGH for action security_group_rules [ 797.268879] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGH for action security_group_rules [ 797.268993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.408903] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.410096] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.574886] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.622580] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 511ffa69-7259-47ba-91d1-ab46e4d80bcc: rpc.has_security_group_logging(os_id): False [ 797.640833] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.640975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.641066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.641397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.641498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.641750] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.641854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.641916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.642082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.642155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.642239] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc is going to be created. [ 797.712585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.712762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.712924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.713134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.713409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.727126] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: IN_PROGRESS for 2s [ 797.912225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.912626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.912626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.912626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.913085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.913085] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be created. [ 797.914488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.914717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.914717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.914941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.915076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.915191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 797.944873] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.945333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.945333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.945511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.945563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.963380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.963643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.963643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.963985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.964100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.976752] env[65427]: INFO networking_nsxv3.common.synchronization [req-2130fd46-e9ed-49b4-bb61-d956721c9e7e req-b0247334-9b1b-4132-9871-0159d1e2f64a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 797.977838] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: UNINITIALIZED for 2s [ 797.978578] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 797.979210] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 797.979412] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGH for action security_group_rules [ 797.979546] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 with Priority: HIGH for action security_group_rules [ 797.979651] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGH for action security_group_rules [ 797.979752] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 with Priority: HIGH for action security_group_rules [ 797.979902] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGH for action security_group_rules [ 797.980079] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGH for action security_group_rules [ 797.980201] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 with Priority: HIGH for action security_group_rules [ 797.980412] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e with Priority: HIGH for action security_group_rules [ 797.980489] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGH for action security_group_rules [ 797.980609] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGH for action security_group_rules [ 797.980719] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 008bf551-bcd7-451b-8250-579db77bad7d with Priority: HIGH for action security_group_rules [ 797.980815] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 797.980963] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 with Priority: HIGH for action security_group_rules [ 797.981088] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08d6a87-c5be-4f46-9078-9a60601143bd with Priority: HIGH for action security_group_rules [ 797.982012] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGH for action security_group_rules [ 797.982158] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d with Priority: HIGH for action security_group_rules [ 797.982269] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee with Priority: HIGH for action security_group_rules [ 797.982393] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGH for action security_group_rules [ 797.982973] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89734b51-576f-441c-a85a-6861eb7a5b94 with Priority: HIGH for action security_group_rules [ 797.982973] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 with Priority: HIGH for action security_group_rules [ 797.983195] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.983301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.983366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.983540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.983709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.983923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.984060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.984491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.984491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.984491] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.985690] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.985836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.986262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.986262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.986262] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.987389] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d7ed4a-3466-430c-b324-25493c8ea5f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.987814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.987814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.987814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.988015] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d7ed4a-3466-430c-b324-25493c8ea5f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.989256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.989448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.989509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.990454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.990454] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.990972] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7c8992c-2da4-43aa-a91a-0a4902c45817 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.991209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.991209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.991495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.991495] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7c8992c-2da4-43aa-a91a-0a4902c45817',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.992530] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.992655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.992719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.992883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.993472] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.994527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.995057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.995187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.995315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.995405] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.996942] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e987c094-a21a-43f5-a474-5ed1b1a855b6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.997173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.997173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.997371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.997457] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e987c094-a21a-43f5-a474-5ed1b1a855b6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.999164] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.999307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.999397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.999519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.999608] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06cf1e57-ae2c-4617-80cf-281da56f6c6e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.004044] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.004187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.004273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.004529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.004584] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.005041] env[65427]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 798.011418] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.011863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.012037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.012305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.012467] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.014527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-008bf551-bcd7-451b-8250-579db77bad7d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.014805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.015034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.015099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.015216] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('008bf551-bcd7-451b-8250-579db77bad7d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.017083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.017083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.018306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.018634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.018792] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.022788] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.023146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.023146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.023472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.023647] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfc5b74e-b81a-42f3-a700-31dc0eae6488',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.025411] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e08d6a87-c5be-4f46-9078-9a60601143bd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.025625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.025957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.026138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.026220] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e08d6a87-c5be-4f46-9078-9a60601143bd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.027914] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.028632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.028632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529af775-9e29-4633-b5c4-0f3bcc0e524d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.029030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.029030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.029148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.029252] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529af775-9e29-4633-b5c4-0f3bcc0e524d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.031011] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.031154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.031252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.031491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.031632] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d911c02-2fb8-4b8a-94ab-e744e4a812ee',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.033313] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.033313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.033658] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89734b51-576f-441c-a85a-6861eb7a5b94 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.033853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.033959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.034279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.034420] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89734b51-576f-441c-a85a-6861eb7a5b94',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.036062] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.036271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.036394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.036686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.036817] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edd2e5f2-2b98-4da6-a58d-0f7cac660a06',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.046924] env[65427]: INFO networking_nsxv3.common.synchronization [req-2130fd46-e9ed-49b4-bb61-d956721c9e7e req-b0247334-9b1b-4132-9871-0159d1e2f64a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 798.047109] env[65427]: INFO networking_nsxv3.common.synchronization [req-2130fd46-e9ed-49b4-bb61-d956721c9e7e req-b0247334-9b1b-4132-9871-0159d1e2f64a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 798.047308] env[65427]: INFO networking_nsxv3.common.synchronization [req-2130fd46-e9ed-49b4-bb61-d956721c9e7e req-b0247334-9b1b-4132-9871-0159d1e2f64a tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 798.053124] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_rules [ 798.053124] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 798.053124] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde07091-d397-473a-96d2-9ac0b1352702 with Priority: HIGHEST for action port [ 798.055707] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.056214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.057121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.057121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.057121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde07091-d397-473a-96d2-9ac0b1352702 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.057121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.057121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.057121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.058042] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde07091-d397-473a-96d2-9ac0b1352702',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.058042] env[65427]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 798.090028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef110958-8d53-4daf-a376-677eb87ffe7f: rpc.has_security_group_logging(os_id): False [ 798.281145] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 798.281517] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 798.281517] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 798.285495] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 798.285495] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 798.285495] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 798.285957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.286082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.286385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.286385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.286642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.286718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.287242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.287242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.288096] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.288096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.288814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.288814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.288814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.288814] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.292634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.292825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.292867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.293144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.320054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.320054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.322567] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 798.322735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.324098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.324098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.324098] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.324098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.324098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.324409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.324409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.324409] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.340460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.341486] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.341486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.341486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.341486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.341486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.341486] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 798.343481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.343686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.348049] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_rules [ 798.348049] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 798.348049] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 798.349241] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 798.349241] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_rules [ 798.349241] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 798.349241] env[65427]: INFO networking_nsxv3.common.synchronization [req-192814c5-dd4f-4547-a440-091c5390ad79 req-e37a1fb8-65e1-483c-bbef-964b96fdb92a tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 798.350368] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_rules [ 798.350513] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 798.350616] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 798.350908] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.350987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.351063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.351322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.351406] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.352343] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.352441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.375677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.375910] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e08d6a87-c5be-4f46-9078-9a60601143bd is going to be deleted. [ 798.455342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.455635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.455731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.455960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.456148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.462312] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.462809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.462809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.462809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.462979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.463193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e08d6a87-c5be-4f46-9078-9a60601143bd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.463654] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b with Priority: HIGHEST for action port [ 798.463981] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.464156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.477787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 798.540692] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.541869] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.542052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.542100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.542310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.542495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.542601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.542677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.542820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.542907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.542997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.543720] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.567028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde07091-d397-473a-96d2-9ac0b1352702 with status ACTIVE [ 798.567293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.567435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.567511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.567716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.567839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.567998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.568296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.568296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.568435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.568435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.568624] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.568746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.568810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.568983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.569092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.569230] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde07091-d397-473a-96d2-9ac0b1352702 is going to be updated. [ 798.597469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.597733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.597733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.597889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.611972] env[65427]: INFO networking_nsxv3.common.synchronization [req-00f4917d-f32f-4828-9643-c82c6cc5a6ef req-4d3d4ef0-8aff-4cea-993e-ce5e1d075d0d tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 798.614009] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.614009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.615631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde07091-d397-473a-96d2-9ac0b1352702" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.618034] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_rules [ 798.618034] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-815486f0-92c9-4599-83fd-da8c97cc0d7b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.618034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.618444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.618444] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815486f0-92c9-4599-83fd-da8c97cc0d7b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.626904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.627185] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d7ed4a-3466-430c-b324-25493c8ea5f4 is going to be deleted. [ 798.628937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.629344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.657317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.657581] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd2e5f2-2b98-4da6-a58d-0f7cac660a06 is going to be deleted. [ 798.727257] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.727433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.727522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.727805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.727929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.728095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d7ed4a-3466-430c-b324-25493c8ea5f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.728491] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 798.728868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.728988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.753747] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.753991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.754114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.754362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.754464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.754637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edd2e5f2-2b98-4da6-a58d-0f7cac660a06" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.754998] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 798.755319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.755414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.758990] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.759183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.759248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.759654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.759848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.759953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.760039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.760238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.760341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.760414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.760523] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.766271] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.766418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.766509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.767205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.767205] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.767205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.767205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.767205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.767623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.767942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.767942] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.771280] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.773486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.773668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.773964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.774291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.774433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.774433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.774625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.774761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.774893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.775031] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.784699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.784898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.784898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.785145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.785324] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.785433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.785488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.785637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.785712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.785800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.785886] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.791814] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.792030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.792168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.792389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.792653] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.792653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.792778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.792894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.792988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.793092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.793182] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.804438] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.806551] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.806770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.807367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.807367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.827238] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.846281] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.846452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.853459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.853615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.888649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.888892] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.889703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.889845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.890581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.890673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.891501] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.891600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.892412] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.892547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.898281] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.898527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.900452] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.900660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.913097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.913338] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 008bf551-bcd7-451b-8250-579db77bad7d is going to be deleted. [ 798.914611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.915011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.956864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.957043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfc5b74e-b81a-42f3-a700-31dc0eae6488 is going to be deleted. [ 798.958454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.958774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.991180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.991587] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7c8992c-2da4-43aa-a91a-0a4902c45817 is going to be deleted. [ 798.992655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.993036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.032802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.033052] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be deleted. [ 799.034114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.034395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.046355] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.047631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.047867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.048018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.048277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.049088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.049088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.049088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.049088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.049088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.049088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.049088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.050500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.051887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.052223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.052500] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.052729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.052901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.053240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.054034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.054191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.054381] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.068482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.068617] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89734b51-576f-441c-a85a-6861eb7a5b94 is going to be deleted. [ 799.070300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.070521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.097812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.098620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.100124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.101113] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e987c094-a21a-43f5-a474-5ed1b1a855b6 is going to be deleted. [ 799.102298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.102363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.102969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.102969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.102969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.102969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-008bf551-bcd7-451b-8250-579db77bad7d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.103295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.103327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.104578] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 799.105841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.105959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121382] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121382] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 815486f0-92c9-4599-83fd-da8c97cc0d7b with status ACTIVE [ 799.121382] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.121382] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.122084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.122084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.122084] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.122213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.122213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.122432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.122432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.122537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 815486f0-92c9-4599-83fd-da8c97cc0d7b is going to be updated. [ 799.128988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.129139] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06cf1e57-ae2c-4617-80cf-281da56f6c6e is going to be deleted. [ 799.130104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.130331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.180530] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.180530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.183934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.183934] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529af775-9e29-4633-b5c4-0f3bcc0e524d is going to be deleted. [ 799.184380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.184624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.184707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.184901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfc5b74e-b81a-42f3-a700-31dc0eae6488" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.186336] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.186336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.186336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.186770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.186770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.186916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.187127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.187252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.189444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.189579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.189579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.190125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.190125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.190125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815486f0-92c9-4599-83fd-da8c97cc0d7b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.190783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.190783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.190783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.190783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.191026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.191026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.191114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.192220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.192220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.192220] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.266917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.266917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.266917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.267720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.269145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.269145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.269145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.269145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.269145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.269145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.269434] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.269479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.269659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.269837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.270082] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.270176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.270255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.270646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.270646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.270796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.270951] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.272953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.273475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.273616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.274256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.274531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.274801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.274801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.274965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.275068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.275167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.275342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.275443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.275506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.275663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.275855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.275987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.275987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.276218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.276218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.276294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.276379] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.300852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.301026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.301102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.301330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.301509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.301612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.301677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.301834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.301918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.302014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.302173] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.302265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.302328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.302517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.302648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.302737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.302799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.303218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.303218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.303218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.303345] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.305463] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.306318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.306461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.306499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.306669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.306823] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.306912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.307016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.307145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.307227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.307612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.307799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.307896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.307989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.308119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.308265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.308349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.308411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.308619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.308619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.308698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.309071] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.310164] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.313413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.313600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.329861] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.336017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.336731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d911c02-2fb8-4b8a-94ab-e744e4a812ee is going to be deleted. [ 799.338037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.338243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.338346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.338468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89734b51-576f-441c-a85a-6861eb7a5b94" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.338932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.339204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.339297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.339417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7c8992c-2da4-43aa-a91a-0a4902c45817" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.339975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.340153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.340259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.340401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e987c094-a21a-43f5-a474-5ed1b1a855b6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.362531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.362769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.362769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.362956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.363114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.363183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06cf1e57-ae2c-4617-80cf-281da56f6c6e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.366753] env[65427]: INFO networking_nsxv3.common.synchronization [req-76635478-a71f-4bcb-96cf-f9e042c830e2 req-b2ed95de-5ff3-4b63-a15f-d54c1a79c7b9 tempest-ServersTestFqdnHostnames-2109873929 tempest-ServersTestFqdnHostnames-2109873929-project-member] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 799.367544] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 799.367960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.368156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.368278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.368616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.368835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.368980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.369095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.370330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.370330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.370330] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.391794] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.391946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529af775-9e29-4633-b5c4-0f3bcc0e524d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.542692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.542889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.542983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.543293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.543415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.544797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d911c02-2fb8-4b8a-94ab-e744e4a812ee" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.557253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.557253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.557449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.557617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.557733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.557800] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 799.559162] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc0cbb36-d62c-40ce-9e79-61f04e36627f: rpc.has_security_group_logging(os_id): False [ 799.604352] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.604352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.604624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.604684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.650777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.651170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.651305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.651387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.651602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.651748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.652032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.652151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.652226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.652418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.652494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.652708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.652875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.652963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.653135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.653211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.653298] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 799.658607] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.658607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.658607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.658607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.658607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.677041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 799.693653] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.750979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: SUCCESS [ 799.751164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.779738] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.779929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.779977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.780745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.780745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.781767] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd36953-3031-481f-ae25-8e10517a449e: rpc.has_security_group_logging(os_id): False [ 799.782849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 799.804805] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.805016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.805077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.806157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.806979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.807102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.809691] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 799.810926] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c8bca44-f080-48fc-9d94-91ea357c71c7: rpc.has_security_group_logging(os_id): False [ 799.814373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f47490-5211-4c8e-9e0a-b7d44c25960f: rpc.has_security_group_logging(os_id): False [ 799.814373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f440566-de23-4d5d-b5b9-fdddf6cee691: rpc.has_security_group_logging(os_id): False [ 799.818915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.819305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.819496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.819812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.820060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.820283] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd is going to be created. [ 799.824399] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.824867] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.825303] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.825934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.827063] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.827443] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.829197] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.829197] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.829197] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.829197] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.829197] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.829411] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.830061] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.830061] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.830061] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.830061] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.832494] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.832771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.832771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.833031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.833167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.833296] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 799.837071] env[65427]: INFO networking_nsxv3.common.synchronization [req-9a401402-ac1e-45e1-abfd-f821a68016d8 req-a4ed04a5-e945-42db-8c77-e9fd2611e64c tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 799.838115] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 799.838509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.838667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.838758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.838983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.839256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.839364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.839431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.839621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.839731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.839871] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.860469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.860838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.860966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.861058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.862882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.862882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.862882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.863386] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 799.864659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.864880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.867242] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.867351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.868747] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.868747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.872099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.872099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.899218] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.899417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.899489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.899704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.899879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.903775] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.904008] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.905051] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.906836] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.075 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.906836] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.906836] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.906836] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-9cff94fe-a8cd-4547-b401-1b53fe96c44f taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.906836] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.906836] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.908485] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.908485] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cff94fe-a8cd-4547-b401-1b53fe96c44f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.918510] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: UNINITIALIZED for 2s [ 799.918510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.918510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.918510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.918510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.918922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.918922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.918922] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.919098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.919098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.919201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.919279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.919469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.919551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.919613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.919752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.919829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.919924] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 799.921278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.921447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.966318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.966630] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.966753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.966820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.967062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.967155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.967302] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.967405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.967467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.967664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.967741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.967925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.968011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.968463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.968463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.968463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.968463] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 799.970037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.970235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.970316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.970506] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.970601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.971041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.971228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.971313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.971391] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a already deleted. [ 799.971470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.972009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.972265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.975768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.975975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.975975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.976188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.976353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 799.992245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.992658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.993103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.993103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.993103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.993302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.993338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.993430] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.995548] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.995698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.996424] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 799.996616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.997566] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 799.998713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.998923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.999115] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.999230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.999306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.999462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.999545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.999640] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.001337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.001924] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.001924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.001924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.001924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.006454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.006454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.006454] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.006454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.036715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.036963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.037146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.037203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.037431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.037431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.037572] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f is going to be updated. [ 800.039595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.039719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.039872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.056986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.057079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.057191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.057351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.057499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.064532] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 800.082688] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 800.117032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.117032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.117032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.117032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.117032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.118724] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.118998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.119182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.119487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.119743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.152611] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 800.165913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.168244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.168244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.168244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.168244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.190736] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 800.197299] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.209800] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: IN_PROGRESS for 2s [ 800.344864] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.410833] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.411049] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.411157] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.411457] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.411614] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.411989] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 9cff94fe-a8cd-4547-b401-1b53fe96c44f not found, creating... [ 800.412117] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.412297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.412427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.412671] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.412816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.413151] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.413393] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.413513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.413734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.413898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.414065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 9cff94fe-a8cd-4547-b401-1b53fe96c44f is going to be created. [ 800.439508] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.439801] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.439862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.440206] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.440401] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.440657] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.496191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 800.496469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.496582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.496814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.496926] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.501678] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.508654] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.699948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.700312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.700312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.700479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.700579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.700683] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 800.740100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.740289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.740381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.740607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.740785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.750639] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 800.850247] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.999965] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.999965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.005010] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.010540] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.078538] env[65427]: INFO networking_nsxv3.common.synchronization [req-76635478-a71f-4bcb-96cf-f9e042c830e2 req-cf6d69ad-c569-4d45-a461-0a8c2dc979b3 service nova] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 801.078724] env[65427]: INFO networking_nsxv3.common.synchronization [req-76635478-a71f-4bcb-96cf-f9e042c830e2 req-cf6d69ad-c569-4d45-a461-0a8c2dc979b3 service nova] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 801.078930] env[65427]: INFO networking_nsxv3.common.synchronization [req-76635478-a71f-4bcb-96cf-f9e042c830e2 req-cf6d69ad-c569-4d45-a461-0a8c2dc979b3 service nova] Enqueued Resource ID: 9cff94fe-a8cd-4547-b401-1b53fe96c44f with Priority: HIGHEST for action port [ 801.079450] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_rules [ 801.079608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 801.079669] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cff94fe-a8cd-4547-b401-1b53fe96c44f with Priority: HIGHEST for action port [ 801.079947] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.080127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.080181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.080458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.080458] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.081564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.081709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.081875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.081979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.082149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.082248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.082304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.082449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.082536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.082629] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.083687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cff94fe-a8cd-4547-b401-1b53fe96c44f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.083804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.083899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.084133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.084201] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cff94fe-a8cd-4547-b401-1b53fe96c44f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.352250] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.352403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.352477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.352707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.352800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.352904] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 801.386654] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.386879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.386879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.387027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.387294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.409726] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 801.436760] env[65427]: INFO networking_nsxv3.common.synchronization [req-171878fb-dd39-4435-8dae-d30658e711d0 req-ed5d8cdd-8ffc-4e8a-97dc-91479530d89e tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 801.437565] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 801.437989] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.438111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.438111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.438561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.438561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.438561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.438669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.438760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.438865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.438947] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.508237] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.508237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.508237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.508237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.508237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.508237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be updated. [ 801.513045] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.513197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.513436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.513494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.513586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.513627] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 801.540089] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.540089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.540089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.540089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.540089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.542535] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.542535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.542535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.542918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.542918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.556631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 801.557442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 801.585504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.585708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.585896] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.586812] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cff94fe-a8cd-4547-b401-1b53fe96c44f with status ACTIVE [ 801.587162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.587282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.587349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.587561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.587685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.587820] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.587914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.587976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.588196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.588230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.588407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.588535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.588573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.588858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.588858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.588858] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cff94fe-a8cd-4547-b401-1b53fe96c44f is going to be updated. [ 801.623620] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.623620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.623620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.623620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.623620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.623620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cff94fe-a8cd-4547-b401-1b53fe96c44f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.688526] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 801.688996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.688996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.690906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.690906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.690906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.690906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.691139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.691139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.691256] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.825079] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 801.826215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.929044] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: SUCCESS [ 801.929145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.929353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.929589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.929786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.929920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.929968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.930125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.930198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.930307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.930408] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.931278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.931479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.931630] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.931737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.931816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.932030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.932030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.932178] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.943431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.943431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.943431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.944014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.944014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.944149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.944149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.944242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.944429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.944491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.945296] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 801.977668] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.977668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.977668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.977878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.978077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.988277] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 802.006048] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 802.006397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.007289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.007289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.007289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.007427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.007488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.007670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.007753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.007842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.008021] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.008118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.008180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.008350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.008517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.008613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.008676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.008815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.008898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.008972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.009099] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.043569] env[65427]: INFO networking_nsxv3.common.synchronization [req-ae47a28a-c2a9-42f7-8196-66dbe6e960ee req-8401786b-5a10-4bcb-adc4-2cb2cf114016 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 802.044242] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 802.044567] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.045683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.045683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.046327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.046327] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.046327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.046327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.046327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.046327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.046569] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.078933] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 802.079178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.092256] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.098091] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 802.098341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.170278] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 802.170862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.194568] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.206427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 802.206862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.221374] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: SUCCESS [ 802.222051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.434175] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.435448] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.501012] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.501195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.501395] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.501669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.501995] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.502168] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.502282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.502572] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.502719] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.502956] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.503080] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.503184] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.503288] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.503394] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.503494] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.503627] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.511031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f63122d-80d5-406e-9516-33dde99d684a: rpc.has_security_group_logging(os_id): False [ 802.522673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.522838] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.523008] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.523212] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.523543] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-c2519211-1830-4436-abb6-57cc9a0ccfc8 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.523728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.523901] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.524235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.524370] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2519211-1830-4436-abb6-57cc9a0ccfc8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.528105] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.528234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.528303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.528497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.549051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.549398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.549538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.549598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.549745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.549826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550038] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.550228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.550228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.550440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.550571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550663] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.550807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.550869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.550980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.551072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.551158] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 802.552518] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.552645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.552691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.553089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.553181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.553359] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.553456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.553518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.553660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.553735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.553918] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be deleted. [ 802.585532] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.585764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.585764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.585949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.586052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.586184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.596185] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.596396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.596396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.596640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.596692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.596787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a is going to be created. [ 802.623604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.623742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.623813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.624110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.624292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.626271] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.626425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.626497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.626672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.626839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.640316] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: UNINITIALIZED for 2s [ 802.647108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 802.696908] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.760862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 802.760862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.937341] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd: rpc.has_security_group_logging(os_id): False [ 802.938485] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.956040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.956206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.956247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.956455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.956541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.956769] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.956869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.956929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.957098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.957173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.957259] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd is going to be created. [ 803.009265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.009501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.009501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.009684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.009862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.021364] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: IN_PROGRESS for 2s [ 803.026610] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.026905] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.026990] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.027250] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.027628] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.027816] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port c2519211-1830-4436-abb6-57cc9a0ccfc8 not found, creating... [ 803.028108] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.028272] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.028385] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.028615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.028750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.029040] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.029203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.029311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.029514] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.029646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.029781] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: c2519211-1830-4436-abb6-57cc9a0ccfc8 is going to be created. [ 803.051281] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.051483] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.051621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.052000] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.052294] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.052547] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.199188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.199399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.199479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.201525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.201525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.201525] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 803.227875] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.227981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.228169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.230488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.230488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.243534] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 803.420701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 803.420701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.441479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.441669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.441739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.442202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.442202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.442202] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd is going to be updated. [ 803.476066] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.476066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.476066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.476259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.476310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.487578] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: IN_PROGRESS for 2s [ 803.568045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 803.568345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.568763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.568939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.569056] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.569151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.569221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.569377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.569512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.569578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.569653] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.571197] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 803.571379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.571526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.571725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.571895] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.572340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.572340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.572340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.572340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.572340] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.573122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.573408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.573539] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.573539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.573631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.573715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.573810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.573911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.574069] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.575059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.575286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.575400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.575481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.575538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.575675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.575749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.575833] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.780466] env[65427]: INFO networking_nsxv3.common.synchronization [req-ae47a28a-c2a9-42f7-8196-66dbe6e960ee req-a5ab13b6-55e0-4e6a-b0b5-ccf9b0b2e719 service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 803.780714] env[65427]: INFO networking_nsxv3.common.synchronization [req-ae47a28a-c2a9-42f7-8196-66dbe6e960ee req-a5ab13b6-55e0-4e6a-b0b5-ccf9b0b2e719 service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 803.780795] env[65427]: INFO networking_nsxv3.common.synchronization [req-ae47a28a-c2a9-42f7-8196-66dbe6e960ee req-a5ab13b6-55e0-4e6a-b0b5-ccf9b0b2e719 service nova] Enqueued Resource ID: c2519211-1830-4436-abb6-57cc9a0ccfc8 with Priority: HIGHEST for action port [ 803.784358] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 803.784522] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 803.784626] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2519211-1830-4436-abb6-57cc9a0ccfc8 with Priority: HIGHEST for action port [ 803.785139] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.789068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.789209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.789481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.789607] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.791577] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.791636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.791757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.791930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792124] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.792555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.792555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.792555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.792555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.792746] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.793490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2519211-1830-4436-abb6-57cc9a0ccfc8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.793600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.793667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.793818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.793967] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2519211-1830-4436-abb6-57cc9a0ccfc8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.998696] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 803.999020] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f deletion is rescheduled due to dependency. [ 803.999020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.076105] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.077629] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.079503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.079610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080049] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.296791] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.296982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.297475] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2519211-1830-4436-abb6-57cc9a0ccfc8 with status ACTIVE [ 804.297475] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.297475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.297681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.297776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.299051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.299051] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.299051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.299051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.299051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.299051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.299051] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.299585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.299585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.299585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.299585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.299585] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2519211-1830-4436-abb6-57cc9a0ccfc8 is going to be updated. [ 804.302027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.326540] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.326750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.326750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.327032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.327152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.327262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2519211-1830-4436-abb6-57cc9a0ccfc8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.580239] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa68a58d-6f8b-44f5-b4ba-09baa1302d0a: rpc.has_security_group_logging(os_id): False [ 804.581526] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.582947] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.602665] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.602665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.602665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.603282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.603282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.603406] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.603756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.603756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.603756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.603756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.604139] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be created. [ 804.651165] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: SUCCESS [ 804.651463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.651660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.651924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.652174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.652419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.652419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.652659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.653242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.653242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.653715] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.660192] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 804.660192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.660192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.661061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.661061] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.667798] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.668091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.668091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.668356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.668931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.684332] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 804.806312] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.034910] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: SUCCESS [ 805.035327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.086550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.086550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.086550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.086755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.086755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.086818] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be updated. [ 805.088343] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.088653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.088653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.088759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.088859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.089190] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 805.123575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.123681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.123741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.124060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.124242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.128856] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.128856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.128856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.128856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.128856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.143022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 805.143835] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 805.156454] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.165152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.165152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.165152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.165152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.255748] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.257349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.257349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.257918] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.262162] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.262362] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.262474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.262729] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.263010] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.263516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.263516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.263665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.263713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.264031] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.264317] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.264317] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.264443] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.265073] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.265073] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.265073] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.310775] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.310856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.310946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.311200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.311299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.311409] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be created. [ 805.330227] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.330332] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.066 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.330471] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.330646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.330983] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-a1fd87de-2584-4145-9901-2f5299eca032 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.331235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.331382] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.331711] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.334213] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fd87de-2584-4145-9901-2f5299eca032',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.344170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.344333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.344940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.345223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.345458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.356654] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: UNINITIALIZED for 2s [ 805.499964] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: SUCCESS [ 805.500329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.659180] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 876f3d94-1c89-4fc5-91b9-bdd8347c716a: rpc.has_security_group_logging(os_id): False [ 805.668417] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.668613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.668670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.669095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.669295] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.669424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.669512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.669691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.669799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.669909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.670110] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.670230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.670319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.670486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.670646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.670754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.670833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.670953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.671053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.671143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.671233] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.677827] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.677958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.678031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.678233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.678342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.678615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.678728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.678797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.678963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.679064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.679157] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a is going to be created. [ 805.741513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.741722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.741722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.742026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.742210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.753442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: IN_PROGRESS for 2s [ 805.760380] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.835432] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.835707] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.835884] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.836405] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.836493] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.836747] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.836909] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.837083] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.837348] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.837494] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.837797] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.837957] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.838085] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.838298] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.838432] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.838573] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: a1fd87de-2584-4145-9901-2f5299eca032 is going to be updated. [ 805.861487] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.861775] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.861965] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.862330] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.862566] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.862837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.176705] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f63122d-80d5-406e-9516-33dde99d684a: rpc.has_security_group_logging(os_id): False [ 806.196378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.196523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.196610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.196834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.196942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.197199] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.197304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.197369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.197527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.197606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.197804] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.197899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.197965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.198118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.198193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.198388] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.198481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.198559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.198698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.198762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.198866] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 806.264310] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef110958-8d53-4daf-a376-677eb87ffe7f: rpc.has_security_group_logging(os_id): False [ 806.297471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.298565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.298565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.298565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.298565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.299046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.299046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.299046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.299202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.299202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.299268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 806.316641] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.316818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.316893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.317119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.317265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.356412] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 806.386048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.386238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.386338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.386571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.386723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.407057] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 806.559793] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4362496-f0c6-4e47-80fe-a38250743c8c req-232e6f77-4105-48ff-8c4a-6da4f98b3b78 service nova] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 806.560023] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4362496-f0c6-4e47-80fe-a38250743c8c req-232e6f77-4105-48ff-8c4a-6da4f98b3b78 service nova] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 806.560423] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4362496-f0c6-4e47-80fe-a38250743c8c req-232e6f77-4105-48ff-8c4a-6da4f98b3b78 service nova] Enqueued Resource ID: a1fd87de-2584-4145-9901-2f5299eca032 with Priority: HIGHEST for action port [ 806.560744] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_rules [ 806.560959] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 806.560994] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1fd87de-2584-4145-9901-2f5299eca032 with Priority: HIGHEST for action port [ 806.565697] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.565970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.565970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.566279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.566367] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.567950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.568082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.568082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.569715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.569907] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.570034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.570082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.570259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.570355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.570450] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.572899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1fd87de-2584-4145-9901-2f5299eca032 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.572899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.572899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.573122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.573122] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fd87de-2584-4145-9901-2f5299eca032',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.702189] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 806.703781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.703781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.703781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.703781] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.035145] env[65427]: INFO networking_nsxv3.common.synchronization [req-103e36e0-8e0f-4ab1-ae3c-e11a7c922660 req-f3c614c1-92c1-4b19-bab2-a1f5e1912a00 tempest-ServerRescueTestJSONUnderV235-89900854 tempest-ServerRescueTestJSONUnderV235-89900854-project-member] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 807.036438] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGHEST for action security_group_members [ 807.036438] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.036614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.036614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.036729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.036893] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.036985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.037074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.037208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.037293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.037432] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.078164] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.080451] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.080587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.080989] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1fd87de-2584-4145-9901-2f5299eca032 with status ACTIVE [ 807.081200] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.081986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.081986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.081986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.081986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.081986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.082371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.082558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.082882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.082882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.082882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.083071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.083071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.083211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.083331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.083382] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1fd87de-2584-4145-9901-2f5299eca032 is going to be updated. [ 807.115397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.115575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.115627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.116263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.116263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.116410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1fd87de-2584-4145-9901-2f5299eca032" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.162429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 807.164167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.166595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.167700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.167700] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.167700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.167700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.167994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.168039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.168147] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.170105] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 807.170334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.171792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.172840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.172840] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.172840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.172840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.173110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.173110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.174757] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.206780] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.206780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.368158] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 807.368389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.368793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.369033] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.369168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.369235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.369420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.369546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.369598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.369646] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.540046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.540046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.540226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.540344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.540436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.540660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.540782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.540836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.540967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.541057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.541146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be updated. [ 807.573902] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.573902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.573902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.573902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.573902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.581420] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.584741] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: IN_PROGRESS for 2s [ 807.675824] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.677106] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.769886] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: SUCCESS [ 807.770970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.872566] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.872772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.872772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.873102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.873234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.873345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.873411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.873570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.873732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.873795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.873979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.874102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.874143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.874309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.874564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.874658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.874896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.875025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.875127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.875268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.875366] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.086666] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.087513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.087513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.087513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.087513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.087513] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be updated. [ 808.119854] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.119854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.119854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.120460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.120460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.130929] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: IN_PROGRESS for 2s [ 808.178516] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.179257] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.381077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 808.381077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.381077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7abbe624-4b85-4277-bdd0-ed749e166fc9: rpc.has_security_group_logging(os_id): False [ 808.400564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.400897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.401077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.401412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.401711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.402099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.402347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.402518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.402827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.403209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.403657] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.403964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.404176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.404497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.404732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.405171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.405572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.406491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.406689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.406778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.406890] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be created. [ 808.427225] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 808.427524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.427746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.428017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.428097] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.484612] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.484814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.484975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.485214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.485403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.499163] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 808.638623] env[65427]: INFO networking_nsxv3.common.synchronization [req-c52f7c62-efc2-4d26-b15c-d50b378ea727 req-7fbdd525-97e5-4a6c-897f-7560d0958942 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 808.640674] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 808.640674] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.641077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.641260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.643709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.643709] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.681202] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.681436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.681436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.681648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.681804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.681921] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 808.683678] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.683939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.683939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.684130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.684303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.684407] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be updated. [ 808.721431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.721586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.721661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.721945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.722119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.724196] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.724409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.724409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.724608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.724795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.740964] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 808.741703] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 808.930669] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.931278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.931483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.931766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.932234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.932374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.932547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.933264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.933399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.933511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.933631] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.085996] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.086224] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.086369] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.086640] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.086937] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.087267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.087423] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.087639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.087783] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.087995] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.088143] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.088265] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.088603] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.088789] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.088904] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.089089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.109930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.110130] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.110265] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.110449] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.110773] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-2cf707c8-f21d-4bd3-bf10-592e66d82aab taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.110949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.111098] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.111495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.111645] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf707c8-f21d-4bd3-bf10-592e66d82aab',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.144797] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.145095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.145178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.145406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.145553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.145703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.145800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.145924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.146013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.146066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.146157] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c already deleted. [ 809.146231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.435836] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.597724] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a3a09ec4-d23d-4a48-99ce-cc90b26c824c None None] Enqueued Resource ID: 8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35 with Priority: HIGHEST for action port [ 809.599816] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f63122d-80d5-406e-9516-33dde99d684a in Status: SUCCESS [ 809.600090] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f63122d-80d5-406e-9516-33dde99d684a deletion is rescheduled due to dependency. [ 809.600261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.601010] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35 with Priority: HIGHEST for action port [ 809.601414] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.601596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.601698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.602205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.602509] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.614442] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.614756] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.615593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.615593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.615593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.615593] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 2cf707c8-f21d-4bd3-bf10-592e66d82aab not found, creating... [ 809.615757] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.615757] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.615881] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.616110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.616280] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.616645] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.616807] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.616923] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.617319] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.617468] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.617608] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 2cf707c8-f21d-4bd3-bf10-592e66d82aab is going to be created. [ 809.638328] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.638704] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.638859] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.639746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.640111] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.640696] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.938206] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef110958-8d53-4daf-a376-677eb87ffe7f: rpc.has_security_group_logging(os_id): False [ 809.956108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.956285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.956365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.956594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.956689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.957041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.957158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.957223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.957377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.957455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.957544] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 810.021613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.021812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.021860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.022078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.022245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.038073] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 810.106865] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35 [ 810.107315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.107560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.107711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.108089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.108244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.108430] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35 already deleted. [ 810.108619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d07fa18-bc92-42f6-9bf5-7ddee4e0fa35" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.142884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: SUCCESS [ 810.143214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.143512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.143858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.145109] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.145109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.145109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.145109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.145109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.145109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.145109] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.430464] env[65427]: INFO networking_nsxv3.common.synchronization [req-c52f7c62-efc2-4d26-b15c-d50b378ea727 req-8ca243c1-0f24-4108-8f01-af10ccb070c1 service nova] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 810.430635] env[65427]: INFO networking_nsxv3.common.synchronization [req-c52f7c62-efc2-4d26-b15c-d50b378ea727 req-8ca243c1-0f24-4108-8f01-af10ccb070c1 service nova] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 810.430777] env[65427]: INFO networking_nsxv3.common.synchronization [req-c52f7c62-efc2-4d26-b15c-d50b378ea727 req-8ca243c1-0f24-4108-8f01-af10ccb070c1 service nova] Enqueued Resource ID: 2cf707c8-f21d-4bd3-bf10-592e66d82aab with Priority: HIGHEST for action port [ 810.431349] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_rules [ 810.431517] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 810.431580] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf707c8-f21d-4bd3-bf10-592e66d82aab with Priority: HIGHEST for action port [ 810.431867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.431982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.434381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.434381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.434381] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.434381] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.435293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.435293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.435293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.435293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.435446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.435615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.435714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.435915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.436209] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.437155] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cf707c8-f21d-4bd3-bf10-592e66d82aab taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.437300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.438012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.438012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.438012] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf707c8-f21d-4bd3-bf10-592e66d82aab',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.517666] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 810.518050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.647552] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.754025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 810.754025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.754025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.754351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.755027] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.755027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.755027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.756052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.756052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.756052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.756052] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.757845] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 810.758108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.758330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.758386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.758536] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.758644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.758709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.758846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.759583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.759583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.759583] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.759583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.759583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.759583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.759583] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.759846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.759846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.759846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.759938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.759938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.760384] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.787113] env[65427]: INFO networking_nsxv3.common.synchronization [req-ba12d15e-42e1-4bd8-9b82-549aa4115b47 req-90b29bb5-7616-4fda-8983-c61e3ef49c94 tempest-AttachInterfacesUnderV243Test-823840880 tempest-AttachInterfacesUnderV243Test-823840880-project-member] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 810.787351] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGHEST for action security_group_members [ 810.789485] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.789485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.789633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.789699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.789988] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.789988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.790147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.790147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.790233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.790347] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.827264] env[65427]: INFO networking_nsxv3.common.synchronization [req-ab994681-2adb-4776-9336-e6ff8d9c7ba1 req-599f286d-5885-4dee-94ad-7fecc2ae2c3f tempest-ServersV294TestFqdnHostnames-1061498094 tempest-ServersV294TestFqdnHostnames-1061498094-project-member] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 810.827264] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGHEST for action security_group_members [ 810.827264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.827264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.827264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.827768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.827768] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.940080] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.940216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.940404] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.942006] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cf707c8-f21d-4bd3-bf10-592e66d82aab with status ACTIVE [ 810.942214] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.942368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.942440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.942818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.942954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.943154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.943256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.943320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.943485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.943562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.943744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.943836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.943921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.944100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.944230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.944352] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cf707c8-f21d-4bd3-bf10-592e66d82aab is going to be updated. [ 810.972809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.972948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.973016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.973235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.973369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.974533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cf707c8-f21d-4bd3-bf10-592e66d82aab" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.154147] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2caa26d9-b324-42d2-886a-42215d3c4faf: rpc.has_security_group_logging(os_id): False [ 811.189466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.189466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.189700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.189700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.223022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.223240] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.223327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.223327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.223576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.223718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.223849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be updated. [ 811.262120] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.263029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 811.283187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.283187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.283187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.283187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.293783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.293783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.293783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.293783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.310377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.310377] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.310584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.310584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.310829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.310961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.311282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.311434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.311528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.311706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.311782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.313192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.314155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.314155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.314155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.314155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.314155] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 811.315846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.316683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.316911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.320475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.320475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.320475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.321276] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.321488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.321554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.321885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.321885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.322443] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be updated. [ 811.331413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.331745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.331879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.332191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.338090] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: IN_PROGRESS for 2s [ 811.371049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.371436] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.371613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.371677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.372049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.372139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.372268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba is going to be updated. [ 811.375603] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.375711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.376235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.376235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.376235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.401604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: IN_PROGRESS for 2s [ 811.421569] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.421838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.422009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.422261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.422405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.439624] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.440019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.440019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.440019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.440149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.444431] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: IN_PROGRESS for 2s [ 811.448848] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.462186] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 811.767194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa68a58d-6f8b-44f5-b4ba-09baa1302d0a: rpc.has_security_group_logging(os_id): False [ 811.786933] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.787159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.787233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.787448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.787537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.787812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.787984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.788137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.788214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.788247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.788352] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be updated. [ 811.857811] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.857988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.858157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.858303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.858954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.881041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 811.952735] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.952922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.952967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.953802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.953802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.953802] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c is going to be created. [ 811.984109] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.984332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.984396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.984555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.985522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.997883] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: UNINITIALIZED for 2s [ 812.076176] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 812.076561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.351240] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: SUCCESS [ 813.351523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.413136] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef110958-8d53-4daf-a376-677eb87ffe7f in Status: SUCCESS [ 813.413428] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f deletion is rescheduled due to dependency. [ 813.413535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.455810] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba in Status: SUCCESS [ 813.456555] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba deletion is rescheduled due to dependency. [ 813.456555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.480135] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 813.480302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.480483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.480714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.480985] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.915384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 813.915713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.986931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.986931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.986931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.987803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.987803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.987803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.987803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.988189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.988189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.988189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.988305] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.013014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: SUCCESS [ 814.013307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.013481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.013842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.014139] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.014276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.014330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.014497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.014577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.014667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.014761] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.493590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.494099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.494099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.494279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.494474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.494582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.494648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.494833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.494960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.495061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.495233] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.495359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.495445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.495624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.495773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.495869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.495947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.496129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.496224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.496320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.496419] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.517550] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.803268] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c8e5567a-b94e-44d9-84bb-0d39dde0eba8 None None] Enqueued Resource ID: d74c41e9-03b6-433d-acf8-a00a51de5c2d with Priority: HIGHEST for action port [ 814.804480] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d74c41e9-03b6-433d-acf8-a00a51de5c2d with Priority: HIGHEST for action port [ 814.804480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d74c41e9-03b6-433d-acf8-a00a51de5c2d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.804939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d74c41e9-03b6-433d-acf8-a00a51de5c2d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.804939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d74c41e9-03b6-433d-acf8-a00a51de5c2d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.804939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d74c41e9-03b6-433d-acf8-a00a51de5c2d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.804939] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d74c41e9-03b6-433d-acf8-a00a51de5c2d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.999836] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 815.020722] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4990f2fc-b7cf-4fec-8da8-647b0eb8509c: rpc.has_security_group_logging(os_id): False [ 815.023304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.023525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.023525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.023732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.023819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.025134] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.025134] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.025134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.025576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.025746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.025878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.025965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.026161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.026326] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.026446] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 815.042920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.043185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.043289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.043597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.044540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.044849] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.044962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.045062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.045315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.045421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.045544] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c is going to be created. [ 815.113807] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.114479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.114479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.114479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.114479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.122383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.123755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.124598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.124598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.124803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.136342] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: IN_PROGRESS for 2s [ 815.138081] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 815.308868] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d74c41e9-03b6-433d-acf8-a00a51de5c2d [ 815.308868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.308868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.308868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.309521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.309521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.309521] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d74c41e9-03b6-433d-acf8-a00a51de5c2d already deleted. [ 815.309521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d74c41e9-03b6-433d-acf8-a00a51de5c2d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.792833] env[65427]: INFO networking_nsxv3.common.synchronization [None req-48fb865e-cdf5-4b51-bf4b-75bc7c4fe74d None None] Enqueued Resource ID: 60e0beb1-eaf7-490a-aff8-b3eee4ede48a with Priority: HIGHEST for action port [ 815.795365] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e0beb1-eaf7-490a-aff8-b3eee4ede48a with Priority: HIGHEST for action port [ 815.795365] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-60e0beb1-eaf7-490a-aff8-b3eee4ede48a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.795365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60e0beb1-eaf7-490a-aff8-b3eee4ede48a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.795365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60e0beb1-eaf7-490a-aff8-b3eee4ede48a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.795365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60e0beb1-eaf7-490a-aff8-b3eee4ede48a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.795365] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60e0beb1-eaf7-490a-aff8-b3eee4ede48a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.299471] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60e0beb1-eaf7-490a-aff8-b3eee4ede48a [ 816.299471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.299471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.299471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.299471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.299471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.299471] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60e0beb1-eaf7-490a-aff8-b3eee4ede48a already deleted. [ 816.299894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60e0beb1-eaf7-490a-aff8-b3eee4ede48a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.612527] env[65427]: INFO networking_nsxv3.common.synchronization [req-f4d3da45-87fe-4b3e-9d86-d416337a5f91 req-f8c0c99f-fdbf-4ac7-b7e6-9cbe09231106 tempest-ServersAdminNegativeTestJSON-513132739 tempest-ServersAdminNegativeTestJSON-513132739-project-member] Enqueued Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 816.613122] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 584eb45a-7106-4759-8924-ff61fcdd399f with Priority: HIGHEST for action security_group_members [ 816.613469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-584eb45a-7106-4759-8924-ff61fcdd399f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.613998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.614109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.614331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.614508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.614648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.614731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.614921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.614980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.615131] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('584eb45a-7106-4759-8924-ff61fcdd399f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.117967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.118344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.118344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.119657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.140646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.141290] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.141290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.141290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.141533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.142387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.142387] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f is going to be updated. [ 817.152344] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: SUCCESS [ 817.152526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.157862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 817.157862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.157862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.157862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.157862] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.177365] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.177365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.177365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.177365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.177365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.187736] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: IN_PROGRESS for 2s [ 817.525881] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b224f2-2ee5-44ce-9739-a260b312729b req-413e7869-0591-408c-9164-fc75b16444c5 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 817.526546] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 817.526881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.527075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.527443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.527663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.527844] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.527972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.528069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.528228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.528340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.528451] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.660998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.661162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.661162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.661402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.661639] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.661755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.661878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.662526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.662526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.662526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.662526] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.702241] env[65427]: INFO networking_nsxv3.common.synchronization [None req-58955891-01f6-4de5-878f-67332ae0e913 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 817.702241] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 817.704456] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.704456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.704456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.704456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.704456] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.709858] env[65427]: INFO networking_nsxv3.common.synchronization [req-48adde0f-d742-442d-ae8f-5895f74f16c5 req-c95342f6-7adb-446d-8b29-4217aa111044 tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 817.710498] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 817.710498] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.710498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.710733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.710733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.710909] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.710993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.712354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.715166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.715830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.715830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.923669] env[65427]: INFO networking_nsxv3.common.synchronization [None req-be42ad02-f686-451e-82cc-c4bb03e23171 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 817.924322] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 817.924642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.924991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.032066] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.032330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.032452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.032659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.065547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.066704] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.066704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.066704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.066704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.066704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.066704] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 818.101511] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.101511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.101511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.101784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.102086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.118734] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 818.166043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.166236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.166287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.166505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.166684] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.166864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.166931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.167108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.167703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.167703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.167703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.167703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.167703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.168087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.168265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.168366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.168433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.168585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.168669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.168841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.168841] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.180767] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.180984] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.181129] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.181398] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.181658] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.181972] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.182110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.182400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.182486] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.182679] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.182789] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.182893] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.183008] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.183121] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.183222] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.183351] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.216840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.217040] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.217313] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.217456] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.217898] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-d4d9dfa0-c95f-4614-8766-4ece35188c51 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.218014] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.218161] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.218681] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.218681] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4d9dfa0-c95f-4614-8766-4ece35188c51',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.219873] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.227228] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.227228] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 already deleted. [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.227228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.227780] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.671118] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 818.693724] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.694019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.694143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.694535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.694676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.694916] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.695121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.695470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.695470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.695633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.695761] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.695943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.695943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.696094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.696215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.696575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.696688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.696754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.696924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.697102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.697102] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 818.722512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.722870] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.723095] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.723438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.723581] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.723738] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port d4d9dfa0-c95f-4614-8766-4ece35188c51 not found, creating... [ 818.724197] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.724459] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.725287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.725287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.725287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.725563] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.725756] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.725852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.726101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.726535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.726535] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: d4d9dfa0-c95f-4614-8766-4ece35188c51 is going to be created. [ 818.727839] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.766083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.766083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.766083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.766083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.766083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.766083] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 already deleted. [ 818.766083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.777328] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.778101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.778690] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.779295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.779988] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.780551] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.851176] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.851413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.851514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.851743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.852022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.878334] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 818.930988] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ff3ffe1d-d5d7-4a3b-a0e2-3067dc00382b None None] Enqueued Resource ID: 686584ef-0ce4-4771-a7e0-d9b832a7fdf7 with Priority: HIGHEST for action port [ 818.932119] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686584ef-0ce4-4771-a7e0-d9b832a7fdf7 with Priority: HIGHEST for action port [ 818.933022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-686584ef-0ce4-4771-a7e0-d9b832a7fdf7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.933453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-686584ef-0ce4-4771-a7e0-d9b832a7fdf7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.933611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-686584ef-0ce4-4771-a7e0-d9b832a7fdf7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.935661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-686584ef-0ce4-4771-a7e0-d9b832a7fdf7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.935830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('686584ef-0ce4-4771-a7e0-d9b832a7fdf7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.200863] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 584eb45a-7106-4759-8924-ff61fcdd399f in Status: SUCCESS [ 819.202177] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 584eb45a-7106-4759-8924-ff61fcdd399f deletion is rescheduled due to dependency. [ 819.202177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-584eb45a-7106-4759-8924-ff61fcdd399f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.230688] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.231109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.231247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.231479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.231568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.235020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 819.268459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.268959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.268959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.270296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.270296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.282672] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 819.438917] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 686584ef-0ce4-4771-a7e0-d9b832a7fdf7 [ 819.439684] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.439942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.440400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.440660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.440789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.440968] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:686584ef-0ce4-4771-a7e0-d9b832a7fdf7 already deleted. [ 819.441278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-686584ef-0ce4-4771-a7e0-d9b832a7fdf7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.583045] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b224f2-2ee5-44ce-9739-a260b312729b req-45f976d1-8617-40bf-9abc-249638362000 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 819.583045] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b224f2-2ee5-44ce-9739-a260b312729b req-45f976d1-8617-40bf-9abc-249638362000 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 819.583434] env[65427]: INFO networking_nsxv3.common.synchronization [req-e3b224f2-2ee5-44ce-9739-a260b312729b req-45f976d1-8617-40bf-9abc-249638362000 service nova] Enqueued Resource ID: d4d9dfa0-c95f-4614-8766-4ece35188c51 with Priority: HIGHEST for action port [ 819.584429] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 819.584582] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 819.584702] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4d9dfa0-c95f-4614-8766-4ece35188c51 with Priority: HIGHEST for action port [ 819.585266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.585409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.585477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.585694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.585781] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.586991] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.587234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.587753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4d9dfa0-c95f-4614-8766-4ece35188c51 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.587901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.587901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.588187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.588277] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4d9dfa0-c95f-4614-8766-4ece35188c51',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.090650] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.090782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.091519] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4d9dfa0-c95f-4614-8766-4ece35188c51 with status ACTIVE [ 820.091519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.091519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.091519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.091770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.091770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.091966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.092067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.092187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.092801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.092801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.092801] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.092801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.092801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.092801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.093251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.093251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4d9dfa0-c95f-4614-8766-4ece35188c51 is going to be updated. [ 820.123559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.124523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.124678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.124966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.125212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.125718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4d9dfa0-c95f-4614-8766-4ece35188c51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.129613] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 820.129788] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 820.129919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.130105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.130343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.130557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.130680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.130762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.130933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.131048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.131154] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.637024] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.899682] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 820.899682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.136233] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.302772] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 821.302947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.638980] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.640060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.640060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.640060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.640060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.640060] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 821.670705] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.670836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.670836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.670995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.671171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.683051] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 822.963022] env[65427]: INFO networking_nsxv3.common.synchronization [req-fc7d3c29-68b5-423d-94bf-0b51b2558ada req-637ead39-0735-4b9a-b6b5-9ecd34ebf081 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 822.963617] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 822.963946] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.964138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.964181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.965562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.965562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.965562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.965562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.965562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.965562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.965562] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.357788] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.358019] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.358135] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.358471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.358741] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.358897] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.359064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.359258] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.359490] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.359728] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.359843] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.359949] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.360067] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.360177] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.360280] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.360409] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.383785] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.384031] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.384213] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.384428] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.384773] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-39f89b2e-12be-4a25-b565-c4a3a58a910e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385015] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.385139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.385519] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.385748] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f89b2e-12be-4a25-b565-c4a3a58a910e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.468722] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.469064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.469177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.469484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.469630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.469951] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.470153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.470268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.470541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.470689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.470844] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 already deleted. [ 823.471011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.678555] env[65427]: INFO networking_nsxv3.common.synchronization [req-ea44acc6-93be-459d-b677-8ed54fb7106e req-4e612121-819d-4c3f-b1b2-506cd0a5486a tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 823.679275] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 823.679656] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.679803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.679883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.680428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.680676] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.680806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.680874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.682566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.682676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.682791] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.695873] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 823.696116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.696364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.696594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.696801] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.696933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.697024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.697190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.697272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.697381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.697513] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.888798] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.889159] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.889159] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.889421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.889576] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.889832] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 39f89b2e-12be-4a25-b565-c4a3a58a910e not found, creating... [ 823.890017] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.890184] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.890301] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.890569] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.890722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.891165] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.891336] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.891490] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.891723] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.891876] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.892092] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 39f89b2e-12be-4a25-b565-c4a3a58a910e is going to be created. [ 823.916901] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.917091] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.917161] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.917453] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.917698] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.918112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.036026] env[65427]: INFO networking_nsxv3.common.synchronization [req-5f5d438a-7e82-4fda-a4c4-ef1212e8a104 req-426963e2-b07c-49f2-bcb7-2c57b6948dbb tempest-ListServersNegativeTestJSON-1303653991 tempest-ListServersNegativeTestJSON-1303653991-project-member] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 824.036671] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGHEST for action security_group_members [ 824.036999] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.037176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.187162] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.201403] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.201646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.201758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.202582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.202582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.202582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.202789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.202866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.203475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.203475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.203475] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.203475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.203689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.203799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.204074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.204205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.204324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.204484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.204707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.204830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.205040] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.659047] env[65427]: INFO networking_nsxv3.common.synchronization [req-fc7d3c29-68b5-423d-94bf-0b51b2558ada req-da213a2b-054f-4091-945f-bf091df6687d service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 824.659241] env[65427]: INFO networking_nsxv3.common.synchronization [req-fc7d3c29-68b5-423d-94bf-0b51b2558ada req-da213a2b-054f-4091-945f-bf091df6687d service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 824.659891] env[65427]: INFO networking_nsxv3.common.synchronization [req-fc7d3c29-68b5-423d-94bf-0b51b2558ada req-da213a2b-054f-4091-945f-bf091df6687d service nova] Enqueued Resource ID: 39f89b2e-12be-4a25-b565-c4a3a58a910e with Priority: HIGHEST for action port [ 824.660278] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 824.660417] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 824.660522] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f89b2e-12be-4a25-b565-c4a3a58a910e with Priority: HIGHEST for action port [ 824.661407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.661720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.661937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.662274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.662414] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.663597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.663793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.663913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.664203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.664467] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.664629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.664730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.664947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.665101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.665267] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.666383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f89b2e-12be-4a25-b565-c4a3a58a910e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.666558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.666772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.666957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.667128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f89b2e-12be-4a25-b565-c4a3a58a910e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.691684] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.708271] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54fe1b7a-483b-4522-ab83-ced21005a9ad: rpc.has_security_group_logging(os_id): False [ 824.726487] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.726634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.726705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.726926] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.727028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.727315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.727472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.727557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.727722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.727802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.728060] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.728221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.728272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.728465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.728546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.728744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.728839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.728901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.729093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.729139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.729260] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 824.798462] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.798462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.798462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.798462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.798462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.809856] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 825.170194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.170194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.170194] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.171642] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39f89b2e-12be-4a25-b565-c4a3a58a910e with status ACTIVE [ 825.172390] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.172526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.172623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.172806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.172899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.173427] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.173427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.173427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.173595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.173595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.173844] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.173921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.173921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.174134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.174234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.174328] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39f89b2e-12be-4a25-b565-c4a3a58a910e is going to be updated. [ 825.194165] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.194355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.194412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.194633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.194722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.194820] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 825.196802] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.196918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.197011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.197192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.197343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.197495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f89b2e-12be-4a25-b565-c4a3a58a910e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.225301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.225473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.225549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.225757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.225902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.236861] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 825.672135] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.175074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.175074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.175074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.175074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.175074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.175074] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be created. [ 826.202622] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.202891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.202992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.203232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.203481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.212642] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: UNINITIALIZED for 2s [ 826.826401] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 826.826714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.248938] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 827.249334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.249381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.249593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.249784] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.249900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.249961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.250139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.250224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.250320] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.587764] env[65427]: INFO networking_nsxv3.common.synchronization [req-9b473fe5-048a-460e-ba08-206028460892 req-be0d4b39-6d83-4234-83d8-60a092f4f5fc tempest-ListImageFiltersTestJSON-1692749154 tempest-ListImageFiltersTestJSON-1692749154-project-member] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 827.588332] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGHEST for action security_group_members [ 827.588637] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.588757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.588817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.589025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.589188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.589283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.589341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.589481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.589564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.589658] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.752137] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.752305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.752418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.752607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.752684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.752887] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.753013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.753054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.753248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.753329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.753448] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be updated. [ 827.779231] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.779386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.779458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.779674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.779816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.789506] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: IN_PROGRESS for 2s [ 828.095053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.095053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.095535] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be updated. [ 828.125518] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.125841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.125841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.126134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.126134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.136078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: IN_PROGRESS for 2s [ 828.223516] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 828.223753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.223931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.224218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.224414] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.224535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.224597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.224754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.224836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.224919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.225034] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.727205] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.230277] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546f1ff4-ef91-4671-86b3-d15ea6055715: rpc.has_security_group_logging(os_id): False [ 829.253552] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.253696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.253696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.254013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.254209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.254512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.254691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.254765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.255191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.255191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.255191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be created. [ 829.321672] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.321848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.321900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.322104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.322310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.332963] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 829.805381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 in Status: SUCCESS [ 829.805752] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 deletion is rescheduled due to dependency. [ 829.805752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.146194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd36953-3031-481f-ae25-8e10517a449e in Status: SUCCESS [ 830.146421] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd36953-3031-481f-ae25-8e10517a449e deletion is rescheduled due to dependency. [ 830.146485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.350403] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 831.350660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.720561] env[65427]: INFO networking_nsxv3.common.synchronization [req-fd7e1f95-7bce-4d11-b6fd-b4b5dfc08aaa req-0a2b4d05-0064-438c-9fe2-49c2f1858df8 tempest-ServersTestJSON-485719575 tempest-ServersTestJSON-485719575-project-member] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 831.721148] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 831.721460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.721583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.721649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.721902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.722127] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.722251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.722335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.722500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.722586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.722683] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.054792] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-502 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.055101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-502" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.055101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-502" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.055466] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-502" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.055741] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.055898] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.056019] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.056238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.056385] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.056863] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.056863] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.056863] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.057027] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.057027] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.057174] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.057237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.076663] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.076837] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.076980] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.077205] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-502" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.077532] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-ea35ad76-4a40-440d-b00e-4a91302b54ae taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.077727] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.077850] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.078211] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.078407] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea35ad76-4a40-440d-b00e-4a91302b54ae',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.225173] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.225342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.225409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.225638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.225728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.225930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.226048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.226114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.226268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.227031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.227031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 already deleted. [ 832.227031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.581121] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.581461] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.581461] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.581710] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.581860] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.582215] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port ea35ad76-4a40-440d-b00e-4a91302b54ae not found, creating... [ 832.582530] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.582764] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.582829] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.583087] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.583195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.583489] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.583646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.584305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.584305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.584305] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: ea35ad76-4a40-440d-b00e-4a91302b54ae is going to be created. [ 832.605834] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.606123] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.606251] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.607039] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.607438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.607759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.360843] env[65427]: INFO networking_nsxv3.common.synchronization [req-fd7e1f95-7bce-4d11-b6fd-b4b5dfc08aaa req-18632a62-d0fb-4818-9f32-df0fd52219f2 service nova] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 833.361043] env[65427]: INFO networking_nsxv3.common.synchronization [req-fd7e1f95-7bce-4d11-b6fd-b4b5dfc08aaa req-18632a62-d0fb-4818-9f32-df0fd52219f2 service nova] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 833.361195] env[65427]: INFO networking_nsxv3.common.synchronization [req-fd7e1f95-7bce-4d11-b6fd-b4b5dfc08aaa req-18632a62-d0fb-4818-9f32-df0fd52219f2 service nova] Enqueued Resource ID: ea35ad76-4a40-440d-b00e-4a91302b54ae with Priority: HIGHEST for action port [ 833.361726] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_rules [ 833.361866] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 833.362209] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea35ad76-4a40-440d-b00e-4a91302b54ae with Priority: HIGHEST for action port [ 833.362622] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.362762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.362834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.363056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.363144] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.365099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.365218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.365292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.365484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.365648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.365747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.365806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.365954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.366078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.366178] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.368680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea35ad76-4a40-440d-b00e-4a91302b54ae taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.370639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.370639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.370639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.370639] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea35ad76-4a40-440d-b00e-4a91302b54ae',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.866235] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.866625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.868772] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.872055] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea35ad76-4a40-440d-b00e-4a91302b54ae with status ACTIVE [ 833.872628] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.872628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.872628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.872812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.872812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.873126] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.873126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.873126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.873286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.873375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.873539] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.873624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.873707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.873829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.873906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.873978] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea35ad76-4a40-440d-b00e-4a91302b54ae is going to be updated. [ 833.897291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.897528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.897586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.897898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.898019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.898226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea35ad76-4a40-440d-b00e-4a91302b54ae" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.374510] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.878048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.878048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.878048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.878447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.878447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.878447] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 is going to be created. [ 834.903864] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.904034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.904168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.904383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.904548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.915973] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: UNINITIALIZED for 2s [ 836.662567] env[65427]: INFO networking_nsxv3.common.synchronization [req-4547825c-1a9d-441d-91da-22365d755239 req-f38b0678-585f-47b6-aa86-d8f66890dda1 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 836.662798] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 836.663234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.663364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.663485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.663831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.664010] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.664364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.664449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.664848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.665236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.665383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.929245] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: SUCCESS [ 836.929487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.929669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.929905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.930119] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.930257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.930336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.930499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.930581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.930672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.930768] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.985616] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.985616] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.985616] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.985965] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.986060] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.986224] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.986342] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.986583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.986726] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.986933] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.987053] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.987160] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.987264] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.987368] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.987468] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.987598] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.009665] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.009837] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.009959] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.010159] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.010477] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.010650] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.010768] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.011154] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.011270] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a44b3f9-b078-4311-94f4-a1ad3a395c8e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.170488] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.170488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.170689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.170814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.170907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.171187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.171299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.171370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.171577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.171872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.171872] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e already deleted. [ 837.171872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.434258] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.513755] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.513982] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.514138] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.514418] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.514571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.514761] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 1a44b3f9-b078-4311-94f4-a1ad3a395c8e not found, creating... [ 837.515048] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.515227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.515345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.515566] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.515704] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.515984] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.516151] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.516269] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.516472] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.516642] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.516788] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 1a44b3f9-b078-4311-94f4-a1ad3a395c8e is going to be created. [ 837.537883] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.538120] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.538256] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.538524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.538759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.538985] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.937849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e21c17b3-5a69-411a-ae70-4a3d9c8d81a8: rpc.has_security_group_logging(os_id): False [ 837.966695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.966890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.966957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.967173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.967273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.967512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.967626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.967683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.967855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.967961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.968085] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 is going to be created. [ 838.031803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.032116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.032290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.032531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.033047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.048064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: IN_PROGRESS for 2s [ 838.328868] env[65427]: INFO networking_nsxv3.common.synchronization [req-4547825c-1a9d-441d-91da-22365d755239 req-a1129b2f-59cf-43f7-906e-7539ad761be6 service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 838.329111] env[65427]: INFO networking_nsxv3.common.synchronization [req-4547825c-1a9d-441d-91da-22365d755239 req-a1129b2f-59cf-43f7-906e-7539ad761be6 service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 838.329252] env[65427]: INFO networking_nsxv3.common.synchronization [req-4547825c-1a9d-441d-91da-22365d755239 req-a1129b2f-59cf-43f7-906e-7539ad761be6 service nova] Enqueued Resource ID: 1a44b3f9-b078-4311-94f4-a1ad3a395c8e with Priority: HIGHEST for action port [ 838.330250] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 838.330250] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 838.330250] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a44b3f9-b078-4311-94f4-a1ad3a395c8e with Priority: HIGHEST for action port [ 838.330495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.330620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.330698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.330992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.331097] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.332287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.332429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.332496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.332694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.332894] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.333052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.333103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.333246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.333317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.335234] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.335234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.335234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.335558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.335558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.335624] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a44b3f9-b078-4311-94f4-a1ad3a395c8e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.838018] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.838713] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.838847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.839020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a44b3f9-b078-4311-94f4-a1ad3a395c8e with status ACTIVE [ 838.839444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.839444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.839444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.839653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.839696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.840298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.840298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.840298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.840298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.840298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.840562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.840562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.840658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.840712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.840790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.840892] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a44b3f9-b078-4311-94f4-a1ad3a395c8e is going to be updated. [ 838.867574] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.867826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.867826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.868047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.868198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.868361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a44b3f9-b078-4311-94f4-a1ad3a395c8e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.343415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.850699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.850942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.850942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.851261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.851383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.851506] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be created. [ 839.880305] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.880476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.880532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.880755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.880916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.891370] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: UNINITIALIZED for 2s [ 840.061978] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: SUCCESS [ 840.061978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.684150] env[65427]: INFO networking_nsxv3.common.synchronization [req-95653058-c1f8-4eb6-bc1f-b7c82b535e88 req-7c500270-3a4f-496e-926f-ae34f6413e38 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 840.687145] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 840.687145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.687145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.687145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.687145] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.023072] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.023356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.023516] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.023884] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.024629] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.024878] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.025068] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.025513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.025755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.026063] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.027099] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.027166] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.027302] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.027468] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.027644] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.027817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.047751] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.047975] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.048298] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.048466] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.048910] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-33ca4ed8-ce80-4456-a6ea-b303900bafd5 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.049452] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.049452] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.049704] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.049898] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33ca4ed8-ce80-4456-a6ea-b303900bafd5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.189898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.190061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.190189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.190349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.190450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.190651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.190781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.190829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.190973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.191081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.191160] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 already deleted. [ 841.191254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.552420] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.552722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.552796] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.553076] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.553295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.553508] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 33ca4ed8-ce80-4456-a6ea-b303900bafd5 not found, creating... [ 841.553820] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.553991] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.554157] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.554397] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.554557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.554841] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.555021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.555138] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.555347] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.555475] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.555631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 33ca4ed8-ce80-4456-a6ea-b303900bafd5 is going to be created. [ 841.576748] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.576979] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.577117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.577454] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.577688] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.579223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.901230] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 841.901552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.901632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.901850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.902050] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.902159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.902236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.902378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.902458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.902544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.902708] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.349189] env[65427]: INFO networking_nsxv3.common.synchronization [req-95653058-c1f8-4eb6-bc1f-b7c82b535e88 req-23211b0c-6705-4ab9-9988-fc3c739e85eb service nova] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 842.349422] env[65427]: INFO networking_nsxv3.common.synchronization [req-95653058-c1f8-4eb6-bc1f-b7c82b535e88 req-23211b0c-6705-4ab9-9988-fc3c739e85eb service nova] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 842.349620] env[65427]: INFO networking_nsxv3.common.synchronization [req-95653058-c1f8-4eb6-bc1f-b7c82b535e88 req-23211b0c-6705-4ab9-9988-fc3c739e85eb service nova] Enqueued Resource ID: 33ca4ed8-ce80-4456-a6ea-b303900bafd5 with Priority: HIGHEST for action port [ 842.350285] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_rules [ 842.350470] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 842.350612] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ca4ed8-ce80-4456-a6ea-b303900bafd5 with Priority: HIGHEST for action port [ 842.350950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.351130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.351238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.351487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.351584] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.352668] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.352764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.352835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.353087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.353312] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.353449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.353525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.353714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.353868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.353964] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.354911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-33ca4ed8-ce80-4456-a6ea-b303900bafd5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.355056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.355184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.355323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.355402] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33ca4ed8-ce80-4456-a6ea-b303900bafd5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.405070] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.405406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.405508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.405743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.406015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.406254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.406345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.406610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.406685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.406922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.407225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.407310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.407367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.407552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.407825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.407992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.408300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.408528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.408704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.408881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.409064] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.857346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.857346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.857518] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.861781] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33ca4ed8-ce80-4456-a6ea-b303900bafd5 with status ACTIVE [ 842.862061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.862221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.862308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.862579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.862706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.862904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.863053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.863140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.863328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.863429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.863632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.863748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.863826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.863988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.864108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.864243] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33ca4ed8-ce80-4456-a6ea-b303900bafd5 is going to be updated. [ 842.884953] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.885183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.885183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.885387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.885524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.885682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33ca4ed8-ce80-4456-a6ea-b303900bafd5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.914621] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 842.934238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.934238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.934238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.934238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.935471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.935471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.935471] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be created. [ 843.008612] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.008612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.008612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.008985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.009157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.032564] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 843.360797] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.865357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.865357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.865357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.865357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.865357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.865357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 is going to be created. [ 843.899980] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.900200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.900200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.900399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.900572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.912492] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: UNINITIALIZED for 2s [ 845.047111] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 845.047491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.579685] env[65427]: INFO networking_nsxv3.common.synchronization [req-c6cd1371-5674-4990-b5d7-b95e55e07b0f req-a1fce57e-e0da-4309-b72b-391d11b2b978 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 845.580382] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 845.581047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.581047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.581047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.581454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.581695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.582517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.582517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.582517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.582517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.582517] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.926711] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: SUCCESS [ 845.927071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.927291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.927595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.927781] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.927928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.928024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.928333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.928333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.928521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.928572] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.994084] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.994399] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.994527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.995053] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.995109] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.995320] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.995532] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.995786] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.995932] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.996152] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.996265] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.996374] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.996479] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.996590] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.997754] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.997754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.016415] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.016722] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.016847] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.017142] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.017357] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-8fac1e80-cfa7-4975-98d9-614345b77bca taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.017529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.017662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.017945] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.018094] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fac1e80-cfa7-4975-98d9-614345b77bca',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.084363] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.084671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.084671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.084785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.084873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.085076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.085212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.085261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.085406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.085497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.085585] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b already deleted. [ 846.085666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.434031] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.523360] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.523557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.523686] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.523998] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.524165] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.524449] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 8fac1e80-cfa7-4975-98d9-614345b77bca not found, creating... [ 846.524723] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.524907] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.525895] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.525895] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.525895] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.527409] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.527409] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.527409] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.527687] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.527687] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.527779] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 8fac1e80-cfa7-4975-98d9-614345b77bca is going to be created. [ 846.548949] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.549621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.549621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.549818] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.549932] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.936815] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c75cceb8-4b60-4a51-8efb-b3b64b024d41: rpc.has_security_group_logging(os_id): False [ 846.956029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.956193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.956193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.956334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.956425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.956671] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.958137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.958259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.958513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.958633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.958746] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 is going to be created. [ 847.021409] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.021629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.021629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.021915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.022041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.039766] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: IN_PROGRESS for 2s [ 847.338255] env[65427]: INFO networking_nsxv3.common.synchronization [req-c6cd1371-5674-4990-b5d7-b95e55e07b0f req-09f68822-d614-4957-86a6-b5e82329c449 service nova] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 847.338591] env[65427]: INFO networking_nsxv3.common.synchronization [req-c6cd1371-5674-4990-b5d7-b95e55e07b0f req-09f68822-d614-4957-86a6-b5e82329c449 service nova] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 847.338591] env[65427]: INFO networking_nsxv3.common.synchronization [req-c6cd1371-5674-4990-b5d7-b95e55e07b0f req-09f68822-d614-4957-86a6-b5e82329c449 service nova] Enqueued Resource ID: 8fac1e80-cfa7-4975-98d9-614345b77bca with Priority: HIGHEST for action port [ 847.339074] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 847.339209] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 847.340399] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fac1e80-cfa7-4975-98d9-614345b77bca with Priority: HIGHEST for action port [ 847.340399] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.340399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.340399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.340399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.340399] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.340898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.340947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.341206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.341708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.341708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.341708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.341708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.341996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.341996] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.344921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fac1e80-cfa7-4975-98d9-614345b77bca taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.344921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.344921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.346240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.346240] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fac1e80-cfa7-4975-98d9-614345b77bca',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.849513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.849650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.849853] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.852207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fac1e80-cfa7-4975-98d9-614345b77bca with status ACTIVE [ 847.852207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.852207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.852207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.852895] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.852895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.852895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.852895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.852895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.852895] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fac1e80-cfa7-4975-98d9-614345b77bca is going to be updated. [ 847.880136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.880325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.880369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.880583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.880799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.880963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fac1e80-cfa7-4975-98d9-614345b77bca" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.356872] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.863183] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.863183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.863183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.863183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.863183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.863183] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be created. [ 848.902871] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.902871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.902871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.903061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.903663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.923946] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: UNINITIALIZED for 2s [ 849.053715] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: SUCCESS [ 849.054072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.742014] env[65427]: INFO networking_nsxv3.common.synchronization [req-79d9bcad-1fef-49af-bf44-758edb87d2f9 req-554e9929-4f5f-4054-bc12-5fa6363a797c tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 849.744650] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 849.744986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.746026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.746026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.746026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.248221] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.248399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.248512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.249220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.249220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.249220] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.249220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.249509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.249566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.249682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.249801] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 850.281332] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.281332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.281332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.281332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.281332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.290138] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 850.384566] env[65427]: INFO networking_nsxv3.common.synchronization [req-6f215868-fb7a-443e-9ccb-88fbf10c40c1 req-e0b59461-c70a-493d-9ef2-11042594aadf tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 850.386280] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 850.386896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.387145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.387308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.387723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.388057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.388364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.388412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.388690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.388866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.389074] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.892383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.935610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 850.935890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.936142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.936442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.936713] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.936890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.937012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.937286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.937427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.937575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.937715] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.395137] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.442313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.897681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.898025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.898025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.898750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.898750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.898750] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 851.932308] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.932455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.932537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.932733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.932981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.944262] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 851.944487] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d451ec0-7db8-47cf-a4b7-45518e01097b: rpc.has_security_group_logging(os_id): False [ 851.964595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.964804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.964944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.965208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.965302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.965799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.965799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.965799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.965986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.965986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.966116] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be created. [ 852.044114] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.044357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.044427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.044638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.044906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.058613] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 852.310157] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 852.310357] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 852.310479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.956199] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 853.956486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.072112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 854.072675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.387392] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 855.387685] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 855.908526] env[65427]: INFO networking_nsxv3.common.synchronization [req-f4f90b87-c8b2-4481-99f9-3f29978987f2 req-e700f13a-2796-40ae-9af7-34d6abcfe3c0 tempest-ServerMetadataTestJSON-1543754644 tempest-ServerMetadataTestJSON-1543754644-project-member] Enqueued Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 855.909065] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 855.909368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.909492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.909559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.909807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.909968] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.910082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.910144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.910288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.910371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.910462] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.266253] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-804 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.266598] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-804" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.266598] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-804" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.266949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-804" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.267243] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.267404] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.267527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.268353] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.268353] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.268353] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.268353] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.268353] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.268624] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.268624] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.268693] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.268786] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.290171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.290407] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.290581] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.290766] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-804" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.291246] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-40a2fbd4-ce7f-466c-871d-e2040e0727d7 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.291397] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.291751] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.292162] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.293024] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a2fbd4-ce7f-466c-871d-e2040e0727d7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.414258] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.414951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.414951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.414951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.414951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.415817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.415817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.415817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.415817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.415817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.415817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e already deleted. [ 856.416135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.795169] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.795399] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.795521] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.795808] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.795973] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.796174] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 40a2fbd4-ce7f-466c-871d-e2040e0727d7 not found, creating... [ 856.796443] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.796683] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.796770] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.796940] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.797096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.797422] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.798089] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.798186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.798369] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.798509] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.798712] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 40a2fbd4-ce7f-466c-871d-e2040e0727d7 is going to be created. [ 856.819746] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.820026] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.820142] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.820437] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.820674] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.820900] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.539543] env[65427]: INFO networking_nsxv3.common.synchronization [req-f4f90b87-c8b2-4481-99f9-3f29978987f2 req-d6199b05-f751-4f94-837c-b83f0e4c7e9f service nova] Enqueued Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_rules [ 857.539543] env[65427]: INFO networking_nsxv3.common.synchronization [req-f4f90b87-c8b2-4481-99f9-3f29978987f2 req-d6199b05-f751-4f94-837c-b83f0e4c7e9f service nova] Enqueued Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 857.539543] env[65427]: INFO networking_nsxv3.common.synchronization [req-f4f90b87-c8b2-4481-99f9-3f29978987f2 req-d6199b05-f751-4f94-837c-b83f0e4c7e9f service nova] Enqueued Resource ID: 40a2fbd4-ce7f-466c-871d-e2040e0727d7 with Priority: HIGHEST for action port [ 857.539849] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_rules [ 857.539849] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 857.540037] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a2fbd4-ce7f-466c-871d-e2040e0727d7 with Priority: HIGHEST for action port [ 857.541957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.543754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.543754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.543754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.543754] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.544961] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.544961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.544961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.545164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.545260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.545446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.545446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.546154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.546154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.546154] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.546706] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a2fbd4-ce7f-466c-871d-e2040e0727d7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.546815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.546815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.547558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.547558] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a2fbd4-ce7f-466c-871d-e2040e0727d7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.049499] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.049668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.049836] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.050792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40a2fbd4-ce7f-466c-871d-e2040e0727d7 with status ACTIVE [ 858.050996] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.051128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.051196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.051396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.051486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.052085] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.052085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.052085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.052085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.052680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.052986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.053107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.053248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.053327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.053402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.053529] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40a2fbd4-ce7f-466c-871d-e2040e0727d7 is going to be updated. [ 858.077068] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.077263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.077468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.077719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.077890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.078094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a2fbd4-ce7f-466c-871d-e2040e0727d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.557484] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.061050] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.061050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.061050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.061050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.061050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.061050] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e is going to be created. [ 859.086903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.087062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.087140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.087328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.087585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.097403] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: UNINITIALIZED for 2s [ 861.108541] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: SUCCESS [ 861.108883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.108964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.109188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.109389] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.109508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.109572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.109724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.109803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.109891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.109984] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.613036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.613196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.613313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.613646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.613899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.614030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.614115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.614355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.614478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.614542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.614754] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.614909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.615040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.615246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.615397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.615493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.615558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.615699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.615819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.615874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.616368] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.119405] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07731512-1a84-409c-8aa3-ceec6c6e184e: rpc.has_security_group_logging(os_id): False [ 862.139803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.140027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.140027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.140463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.140463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.140599] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.140665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.140706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.141636] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.141636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.141931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.141931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.141931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.142075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.142075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.142184] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e is going to be created. [ 862.198860] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.199080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.199080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.199299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.199487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.212391] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: IN_PROGRESS for 2s [ 862.541431] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 862.541719] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 864.228571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: SUCCESS [ 864.228911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.445193] env[65427]: INFO networking_nsxv3.common.synchronization [req-f1a69d1e-6df2-4afc-9dff-2c4d0fc123e2 req-e89aebd8-5186-4c4d-94ae-3278bd1dab7b tempest-ServerTagsTestJSON-1875284588 tempest-ServerTagsTestJSON-1875284588-project-member] Enqueued Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 865.446050] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 865.446394] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.446542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.446639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.446903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.447094] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.447205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.447269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.447422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.447519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.447632] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.935880] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.936610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-552" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.936610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-552" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.936610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-552" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.936908] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.937571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.937571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.937571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.937943] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.938730] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.938730] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.938730] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.938730] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.938730] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.939014] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.939014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.950074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.950211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.950297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.950521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.950614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.950900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.951018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.951018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.951122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.951208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.951295] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 already deleted. [ 865.951465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.957777] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.958014] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.958111] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.958309] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-552" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.958644] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-793cadc6-a14d-4efa-b800-28eb286eeee2 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.958822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.958944] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.959280] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.959857] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cadc6-a14d-4efa-b800-28eb286eeee2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.462020] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.464678] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 793cadc6-a14d-4efa-b800-28eb286eeee2 not found, creating... [ 866.464678] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.464678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.465282] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.465282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.465282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.465424] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.465555] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.465639] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 793cadc6-a14d-4efa-b800-28eb286eeee2 is going to be created. [ 866.486356] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.486552] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.486674] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.486930] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.487171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.487389] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.236402] env[65427]: INFO networking_nsxv3.common.synchronization [req-f1a69d1e-6df2-4afc-9dff-2c4d0fc123e2 req-8c82a322-caf0-442d-8526-9f244a4405e3 service nova] Enqueued Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_rules [ 867.236830] env[65427]: INFO networking_nsxv3.common.synchronization [req-f1a69d1e-6df2-4afc-9dff-2c4d0fc123e2 req-8c82a322-caf0-442d-8526-9f244a4405e3 service nova] Enqueued Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 867.236990] env[65427]: INFO networking_nsxv3.common.synchronization [req-f1a69d1e-6df2-4afc-9dff-2c4d0fc123e2 req-8c82a322-caf0-442d-8526-9f244a4405e3 service nova] Enqueued Resource ID: 793cadc6-a14d-4efa-b800-28eb286eeee2 with Priority: HIGHEST for action port [ 867.237630] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_rules [ 867.237719] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 867.237770] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 793cadc6-a14d-4efa-b800-28eb286eeee2 with Priority: HIGHEST for action port [ 867.238150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.238315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.238406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.238700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.238809] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.239821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.240260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.240260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.240450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.240933] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.240933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.240933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.240933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.240933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.241188] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.241923] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-793cadc6-a14d-4efa-b800-28eb286eeee2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.241923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.242194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.243133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.243133] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('793cadc6-a14d-4efa-b800-28eb286eeee2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.299653] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0f278fd1-d8cc-4f53-b6a7-399f2ab3bf3f None None] Enqueued Resource ID: d149d256-89a2-4175-85a2-cc41e3df5052 with Priority: HIGHEST for action port [ 867.299653] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d149d256-89a2-4175-85a2-cc41e3df5052 with Priority: HIGHEST for action port [ 867.299653] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d149d256-89a2-4175-85a2-cc41e3df5052 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.299653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d149d256-89a2-4175-85a2-cc41e3df5052" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.299653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d149d256-89a2-4175-85a2-cc41e3df5052" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.299653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d149d256-89a2-4175-85a2-cc41e3df5052" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.299653] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d149d256-89a2-4175-85a2-cc41e3df5052',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.744905] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.746152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.746260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.746444] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 793cadc6-a14d-4efa-b800-28eb286eeee2 with status ACTIVE [ 867.746604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.746706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.746770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.746961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.747062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.747227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.747324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.747386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.747573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.747664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.749109] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.749109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.749109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.749109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.749561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.749862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 793cadc6-a14d-4efa-b800-28eb286eeee2 is going to be updated. [ 867.776318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.776318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.776318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.776318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.776318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.776318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-793cadc6-a14d-4efa-b800-28eb286eeee2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.800760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d149d256-89a2-4175-85a2-cc41e3df5052 [ 867.802950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.802950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.802950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.802950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.802950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.802950] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d149d256-89a2-4175-85a2-cc41e3df5052 already deleted. [ 867.802950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d149d256-89a2-4175-85a2-cc41e3df5052" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.907181] env[65427]: INFO networking_nsxv3.common.synchronization [None req-48953b22-103f-426e-8fc3-c32c634e7dd1 None None] Enqueued Resource ID: 1ae14d61-7d4e-4dab-b057-6d9553a95a4a with Priority: HIGHEST for action port [ 867.907181] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae14d61-7d4e-4dab-b057-6d9553a95a4a with Priority: HIGHEST for action port [ 867.907181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ae14d61-7d4e-4dab-b057-6d9553a95a4a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.907181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ae14d61-7d4e-4dab-b057-6d9553a95a4a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.907181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ae14d61-7d4e-4dab-b057-6d9553a95a4a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.907181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ae14d61-7d4e-4dab-b057-6d9553a95a4a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.907181] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ae14d61-7d4e-4dab-b057-6d9553a95a4a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.254779] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.409009] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ae14d61-7d4e-4dab-b057-6d9553a95a4a [ 868.410021] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.410021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.410021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.410021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.410021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.410021] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ae14d61-7d4e-4dab-b057-6d9553a95a4a already deleted. [ 868.410021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ae14d61-7d4e-4dab-b057-6d9553a95a4a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.760784] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.763089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.763089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.763089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.763089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.763089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 is going to be created. [ 868.792912] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.793073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.793129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.793364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.793525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.810283] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: UNINITIALIZED for 2s [ 869.623222] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4b199917-5e1c-49fa-b8b3-a7938bb1e268 tempest-ServersTestBootFromVolume-683815655 tempest-ServersTestBootFromVolume-683815655-project-member] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 869.623454] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 869.623988] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.624261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.624436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.624846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.624993] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.810115] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a952cb25-5866-4fd9-9e86-2e484fe41dc8 tempest-ServersTestBootFromVolume-683815655 tempest-ServersTestBootFromVolume-683815655-project-member] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 869.811471] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 869.813251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.813405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.049291] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7503a8a2-cee9-41ec-a039-6147bf3f3826 None None] Enqueued Resource ID: 15993059-f561-4ad4-92bb-e90755637338 with Priority: HIGHEST for action port [ 870.049408] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15993059-f561-4ad4-92bb-e90755637338 with Priority: HIGHEST for action port [ 870.049758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-15993059-f561-4ad4-92bb-e90755637338 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.049907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15993059-f561-4ad4-92bb-e90755637338" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.049986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15993059-f561-4ad4-92bb-e90755637338" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.056264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15993059-f561-4ad4-92bb-e90755637338" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.056429] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15993059-f561-4ad4-92bb-e90755637338',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.098374] env[65427]: INFO networking_nsxv3.common.synchronization [None req-16ac77ec-0c61-4a02-b426-908f92d792fb None None] Enqueued Resource ID: e47afaf2-7b51-45e8-b20f-67ca12e309ef with Priority: HIGHEST for action port [ 870.100057] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47afaf2-7b51-45e8-b20f-67ca12e309ef with Priority: HIGHEST for action port [ 870.100057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47afaf2-7b51-45e8-b20f-67ca12e309ef taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.100057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47afaf2-7b51-45e8-b20f-67ca12e309ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.100057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47afaf2-7b51-45e8-b20f-67ca12e309ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.100057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47afaf2-7b51-45e8-b20f-67ca12e309ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.100057] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47afaf2-7b51-45e8-b20f-67ca12e309ef',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.151579] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.151767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.151803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.153064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.153064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.153064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 already deleted. [ 870.153064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.153418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.153677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.153774] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.561435] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15993059-f561-4ad4-92bb-e90755637338 [ 870.561867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.561867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.562043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.562453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.562453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.562453] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15993059-f561-4ad4-92bb-e90755637338 already deleted. [ 870.562571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15993059-f561-4ad4-92bb-e90755637338" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.602794] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e47afaf2-7b51-45e8-b20f-67ca12e309ef [ 870.603041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.603181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.603258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.603489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.603578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.603684] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e47afaf2-7b51-45e8-b20f-67ca12e309ef already deleted. [ 870.603780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47afaf2-7b51-45e8-b20f-67ca12e309ef" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.680719] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.680801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.680873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.682516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.682516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.682516] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 already deleted. [ 870.682516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.823638] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: SUCCESS [ 870.823638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.824188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.824188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.824188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.826292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.826292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.826292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.826292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.826292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.826292] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.327584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.327584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.327584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.328220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.328220] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.329479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.329567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.329787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.329881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.329979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.330226] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.330342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.330411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.330571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.330735] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.330831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.330894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.331561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.331561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.331561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.331561] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.706864] env[65427]: INFO networking_nsxv3.common.synchronization [req-b9d7d18f-fba3-40a2-b2b9-abc2a6f57cf9 req-a549e69f-d869-44b1-865a-2605babb07e3 tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 871.707447] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 871.707744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.707993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.707993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.708369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.708539] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.708645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.708709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.709201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.710443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.710585] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.836031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3085df7e-1c09-4942-ba27-49d63274ac56: rpc.has_security_group_logging(os_id): False [ 871.859480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.859638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.859676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.860214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.860214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.860318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.860392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.860457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.860612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.861427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.861427] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.861427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.861427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.861427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.861427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.861427] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.861693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.861693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.861693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.861781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.861847] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 is going to be created. [ 871.924120] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.924323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.924376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.925825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.926435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.939594] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: IN_PROGRESS for 2s [ 872.212792] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.716331] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.221846] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.221846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.221846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.221846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.222279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.222279] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 873.259625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.259778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.259849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.260069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.260218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.271028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 873.952378] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: SUCCESS [ 873.952624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.982420] env[65427]: INFO networking_nsxv3.common.synchronization [None req-70e08f8c-a614-4574-ab92-5d1a78ecf321 None None] Enqueued Resource ID: 0b33aa05-d339-4108-a628-a3e63bdb3c22 with Priority: HIGHEST for action port [ 873.985422] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b33aa05-d339-4108-a628-a3e63bdb3c22 with Priority: HIGHEST for action port [ 873.985422] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b33aa05-d339-4108-a628-a3e63bdb3c22 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.985422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b33aa05-d339-4108-a628-a3e63bdb3c22" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.985422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b33aa05-d339-4108-a628-a3e63bdb3c22" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.985422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b33aa05-d339-4108-a628-a3e63bdb3c22" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.985422] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b33aa05-d339-4108-a628-a3e63bdb3c22',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.490876] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b33aa05-d339-4108-a628-a3e63bdb3c22 [ 874.491192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.491336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.491412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.491674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.491803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.491909] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b33aa05-d339-4108-a628-a3e63bdb3c22 already deleted. [ 874.492039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b33aa05-d339-4108-a628-a3e63bdb3c22" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.282492] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 875.282728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.791257] env[65427]: INFO networking_nsxv3.common.synchronization [None req-103cc886-ec08-47ed-885a-658cd7f17d22 None None] Enqueued Resource ID: 523d7128-1791-4156-a89e-fff872bc03f0 with Priority: HIGHEST for action port [ 876.791924] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 523d7128-1791-4156-a89e-fff872bc03f0 with Priority: HIGHEST for action port [ 876.796728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-523d7128-1791-4156-a89e-fff872bc03f0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.796970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-523d7128-1791-4156-a89e-fff872bc03f0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.797132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-523d7128-1791-4156-a89e-fff872bc03f0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.797478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-523d7128-1791-4156-a89e-fff872bc03f0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.797601] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('523d7128-1791-4156-a89e-fff872bc03f0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.174979] env[65427]: INFO networking_nsxv3.common.synchronization [req-7a88f24c-a062-4d8e-8a83-154f294d45d1 req-a1fa3b9d-10fa-4f9d-8f3f-86f12ccaeb59 tempest-ServerMetadataTestJSON-1543754644 tempest-ServerMetadataTestJSON-1543754644-project-member] Enqueued Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 877.176474] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGHEST for action security_group_members [ 877.176474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.176676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.176676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.177158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.177521] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.177521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.177667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.178139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.178289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.178396] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.302366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 523d7128-1791-4156-a89e-fff872bc03f0 [ 877.302366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.302593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.302593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.302714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.302895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.302895] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:523d7128-1791-4156-a89e-fff872bc03f0 already deleted. [ 877.303035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-523d7128-1791-4156-a89e-fff872bc03f0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.681963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.682184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.682282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.682511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.682681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.682910] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.683041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.683701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.683701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.683701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.683701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e is going to be updated. [ 877.716625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.716889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.717441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.718905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.719630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.730943] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: IN_PROGRESS for 2s [ 878.870952] env[65427]: INFO networking_nsxv3.common.synchronization [req-7a2f03d6-f05f-4b32-a266-6fb14238753b req-3ae3dce2-eebd-4caf-b25c-316fbd342b7f tempest-ServersTestFqdnHostnames-2109873929 tempest-ServersTestFqdnHostnames-2109873929-project-member] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 878.875026] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGHEST for action security_group_members [ 878.875026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.875026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.875026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.875026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.378777] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.378777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.379179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.379450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.379550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.379767] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.379872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.379932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.380467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.380467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.380467] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a is going to be updated. [ 879.414496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.414647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.414713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.414923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.415079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.424742] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: IN_PROGRESS for 2s [ 879.721978] env[65427]: INFO networking_nsxv3.common.synchronization [req-a3ad5b56-61e4-4a41-a262-132fe024feeb req-93482649-401a-4f01-85c2-4c3bc7ede954 tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 879.722636] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGHEST for action security_group_members [ 879.722952] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.723096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.723152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.723349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.723516] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.724598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.724598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.724598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.724598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.724598] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.742430] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07731512-1a84-409c-8aa3-ceec6c6e184e in Status: SUCCESS [ 879.742707] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e deletion is rescheduled due to dependency. [ 879.742877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.226228] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.226648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.226648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.226921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.226921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.227166] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.227278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.227338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.227925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.227925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.227925] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be updated. [ 880.274732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.274732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.274732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.274732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.274732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.284018] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: IN_PROGRESS for 2s [ 880.476150] env[65427]: INFO networking_nsxv3.common.synchronization [req-4614477e-40ef-4767-abb6-2712ea6d409a req-7bb93865-4cdd-40e9-973d-7c39c6bb2462 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 880.476150] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 880.476150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.478323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.478686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.479054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.479344] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.482548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.482548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.482548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.482548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.482548] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.795883] env[65427]: INFO networking_nsxv3.common.synchronization [None req-e1c2a7ae-3ac4-43fa-8030-d6f9788de95d None None] Enqueued Resource ID: 00d35207-deff-4728-9cae-53fa7522bb05 with Priority: HIGHEST for action port [ 880.796463] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00d35207-deff-4728-9cae-53fa7522bb05 with Priority: HIGHEST for action port [ 880.796790] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-00d35207-deff-4728-9cae-53fa7522bb05 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.796909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00d35207-deff-4728-9cae-53fa7522bb05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.797015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00d35207-deff-4728-9cae-53fa7522bb05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.797438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00d35207-deff-4728-9cae-53fa7522bb05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.797532] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00d35207-deff-4728-9cae-53fa7522bb05',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.942869] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.943131] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.943262] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.943584] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.943869] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.944269] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.944504] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.944733] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.944880] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.945110] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.945227] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.946199] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.946359] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.946495] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.946622] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.946792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.974020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.974213] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.974342] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.974678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.975029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-eff73080-a229-4a55-a3de-d938125fbdd9 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.975263] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.975338] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.975852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.976015] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eff73080-a229-4a55-a3de-d938125fbdd9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.982957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.984905] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.984905] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 already deleted. [ 880.984905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.299323] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00d35207-deff-4728-9cae-53fa7522bb05 [ 881.299648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.299722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.299906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.299979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.300176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.300340] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00d35207-deff-4728-9cae-53fa7522bb05 already deleted. [ 881.300469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00d35207-deff-4728-9cae-53fa7522bb05" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.437429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a in Status: SUCCESS [ 881.437639] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a deletion is rescheduled due to dependency. [ 881.437942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.477826] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.478073] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.478208] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.478651] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.478714] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.478847] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port eff73080-a229-4a55-a3de-d938125fbdd9 not found, creating... [ 881.479136] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.480345] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.480345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.480619] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.480691] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.480796] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: eff73080-a229-4a55-a3de-d938125fbdd9 is going to be created. [ 881.503128] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.503499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.503499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.503666] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.503926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.504202] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.252889] env[65427]: INFO networking_nsxv3.common.synchronization [req-4614477e-40ef-4767-abb6-2712ea6d409a req-82ffd9f0-8ba8-4809-a5c4-1cc076f4911e service nova] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 882.253095] env[65427]: INFO networking_nsxv3.common.synchronization [req-4614477e-40ef-4767-abb6-2712ea6d409a req-82ffd9f0-8ba8-4809-a5c4-1cc076f4911e service nova] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 882.253233] env[65427]: INFO networking_nsxv3.common.synchronization [req-4614477e-40ef-4767-abb6-2712ea6d409a req-82ffd9f0-8ba8-4809-a5c4-1cc076f4911e service nova] Enqueued Resource ID: eff73080-a229-4a55-a3de-d938125fbdd9 with Priority: HIGHEST for action port [ 882.253826] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 882.254012] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 882.254056] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff73080-a229-4a55-a3de-d938125fbdd9 with Priority: HIGHEST for action port [ 882.254333] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.255086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.255086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.255086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.255086] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.255820] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.255943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.255989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.256230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.256387] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.256482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.256585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.256690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.256773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.256867] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.257673] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-eff73080-a229-4a55-a3de-d938125fbdd9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.257781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.257846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.259894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.259894] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eff73080-a229-4a55-a3de-d938125fbdd9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.296483] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2caa26d9-b324-42d2-886a-42215d3c4faf in Status: SUCCESS [ 882.296613] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf deletion is rescheduled due to dependency. [ 882.297119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.760152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.760417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.760488] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eff73080-a229-4a55-a3de-d938125fbdd9 with status ACTIVE [ 882.760661] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.760767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.760826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.761049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.761149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.761335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.761475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.761538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.761749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.761873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.762198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.762337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.762409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.762558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.762633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.762719] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eff73080-a229-4a55-a3de-d938125fbdd9 is going to be updated. [ 882.763850] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.789956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.790150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.790222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.790430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.790642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.790742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eff73080-a229-4a55-a3de-d938125fbdd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.248923] env[65427]: INFO networking_nsxv3.common.synchronization [None req-55c7bca5-c34c-41df-8bb6-fe2372c24cd8 None None] Enqueued Resource ID: c1c70549-8f4b-4572-8309-050cc785d6b0 with Priority: HIGHEST for action port [ 883.251800] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c70549-8f4b-4572-8309-050cc785d6b0 with Priority: HIGHEST for action port [ 883.252385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c70549-8f4b-4572-8309-050cc785d6b0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.252664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c70549-8f4b-4572-8309-050cc785d6b0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.252740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c70549-8f4b-4572-8309-050cc785d6b0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.252985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c70549-8f4b-4572-8309-050cc785d6b0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.253141] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c70549-8f4b-4572-8309-050cc785d6b0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.266036] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.754951] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1c70549-8f4b-4572-8309-050cc785d6b0 [ 883.755228] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.755388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.755440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.755656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.755747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.755843] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1c70549-8f4b-4572-8309-050cc785d6b0 already deleted. [ 883.755924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c70549-8f4b-4572-8309-050cc785d6b0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.768515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.768999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.768999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.769315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.769441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.769574] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be created. [ 883.795473] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.795632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.795703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.795912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.796098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.806076] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: UNINITIALIZED for 2s [ 884.378718] env[65427]: INFO networking_nsxv3.common.synchronization [req-db5be076-a9c7-4bae-8fec-77fdbd53ab72 req-e42cb386-e27f-40cb-bd6f-4f766b56150e tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 884.379335] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 884.380465] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.380465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.380465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.380465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.380465] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.381160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.381160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.381160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.381160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.381160] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.814941] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-700 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.815307] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.815501] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.815873] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.816242] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.816552] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.816746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.817048] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.817266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.817550] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.817733] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.817923] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.818128] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.818359] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.818559] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.818770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.842671] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.842858] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.843034] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.843226] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-700" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.843557] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.843745] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.843868] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.844228] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.844415] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.885020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.349252] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.349587] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.349794] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.350257] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.350473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.350666] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc not found, creating... [ 885.351290] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.351290] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.351446] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.351750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.351896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.352299] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.352921] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.353107] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.353349] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.353498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.353693] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc is going to be created. [ 885.376606] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.376852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.376958] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.377291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.377521] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.377755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.387662] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.817600] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 885.817884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.818017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.818242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.818441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.818575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.818674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.818812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.818896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.818982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.819111] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.890957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.891725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.891831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.892102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.892232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.892366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 885.923968] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.924181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.924256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.924502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.924647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.939247] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 886.090261] env[65427]: INFO networking_nsxv3.common.synchronization [req-db5be076-a9c7-4bae-8fec-77fdbd53ab72 req-7e3de4c8-70d5-4b8b-842f-d936b670f814 service nova] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 886.090261] env[65427]: INFO networking_nsxv3.common.synchronization [req-db5be076-a9c7-4bae-8fec-77fdbd53ab72 req-7e3de4c8-70d5-4b8b-842f-d936b670f814 service nova] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 886.090261] env[65427]: INFO networking_nsxv3.common.synchronization [req-db5be076-a9c7-4bae-8fec-77fdbd53ab72 req-7e3de4c8-70d5-4b8b-842f-d936b670f814 service nova] Enqueued Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 886.090354] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 886.090670] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 886.090670] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 886.091168] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.091299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.091368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.091575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.091667] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.093970] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.093970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.093970] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.093970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.093970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.093970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.093970] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.320910] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.595936] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.596126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.597037] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with status ACTIVE [ 886.597037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.597037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.597037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.597275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.597275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.597660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.597660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.597746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.597814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.597898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.598090] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.598184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.598246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.598380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.598466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.598559] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc is going to be updated. [ 886.620505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.620657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.620759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.621201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.621349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.621515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.823427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e65cad1-7b76-434e-8bda-983c5b0b7e56: rpc.has_security_group_logging(os_id): False [ 886.842175] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.842175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.842175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.842429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.842566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.843174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.843174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.843174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.843174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.843366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.843366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be created. [ 886.931980] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.932149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.932233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.932632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.933563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.950798] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 887.071765] env[65427]: INFO networking_nsxv3.common.synchronization [req-e5b2ac7d-770a-4e7b-8467-6437b292ce71 req-8ac4cd7e-02f5-4bbd-a7c4-32f403ece467 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 887.072405] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 887.072683] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.072825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.072896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.073134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073412] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.073412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.073572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.073628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.073818] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.152558] env[65427]: INFO networking_nsxv3.common.synchronization [req-c8fb7188-f8bf-4906-b21a-ffae716bfc99 req-78f31cc4-12e5-425a-851f-3a3960264822 tempest-ServerTagsTestJSON-1875284588 tempest-ServerTagsTestJSON-1875284588-project-member] Enqueued Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 887.153196] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGHEST for action security_group_members [ 887.154116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.154704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.155012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.155126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.155233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.155316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.155436] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.497623] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.497836] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.497960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.498248] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.498507] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.498664] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.498782] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.499037] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.499399] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.499399] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.499495] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.499539] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.499644] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.499801] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.499918] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.500061] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.519411] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.519596] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.519714] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.519887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.521118] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.521118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.521118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.521118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.521118] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c00d3d7b-02be-46a8-a2a3-77c79d5af43a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.576241] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.659161] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.659319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.661024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.661024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.661024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 is going to be updated. [ 887.697951] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.698178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.698273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.698596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.698703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.710451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: IN_PROGRESS for 2s [ 887.951063] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 887.951377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.951458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.951673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.951868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.952016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.952105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.952558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.952558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.952558] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.023863] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.024131] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.024259] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.024577] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.024736] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.024893] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port c00d3d7b-02be-46a8-a2a3-77c79d5af43a not found, creating... [ 888.025181] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.025345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.025482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.025720] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.025861] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.026156] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.026312] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.026427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.026641] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.026770] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.026909] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: c00d3d7b-02be-46a8-a2a3-77c79d5af43a is going to be created. [ 888.048673] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.049983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.049983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.049983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.049983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.049983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.080789] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.454957] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.585110] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.585110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.585110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.585110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.585110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.585110] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 888.617652] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.618278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.618355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.618699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.618863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.631146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 888.811955] env[65427]: INFO networking_nsxv3.common.synchronization [req-e5b2ac7d-770a-4e7b-8467-6437b292ce71 req-e92adb13-9f12-4426-ae68-28aa263fbb52 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 888.812226] env[65427]: INFO networking_nsxv3.common.synchronization [req-e5b2ac7d-770a-4e7b-8467-6437b292ce71 req-e92adb13-9f12-4426-ae68-28aa263fbb52 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 888.812562] env[65427]: INFO networking_nsxv3.common.synchronization [req-e5b2ac7d-770a-4e7b-8467-6437b292ce71 req-e92adb13-9f12-4426-ae68-28aa263fbb52 service nova] Enqueued Resource ID: c00d3d7b-02be-46a8-a2a3-77c79d5af43a with Priority: HIGHEST for action port [ 888.812993] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 888.813247] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 888.813247] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c00d3d7b-02be-46a8-a2a3-77c79d5af43a with Priority: HIGHEST for action port [ 888.813527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.813651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.813817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.814624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.814669] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.820016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.820016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.820016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.820016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.820422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.820422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.820422] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c00d3d7b-02be-46a8-a2a3-77c79d5af43a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.958736] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.963077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 888.963232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.322368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.322600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.322877] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c00d3d7b-02be-46a8-a2a3-77c79d5af43a with status ACTIVE [ 889.323305] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.323305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.323451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.323977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.324967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.324967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.324967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.324967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.324967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.324967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.327294] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.327294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.327294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.327294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.327294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.327294] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c00d3d7b-02be-46a8-a2a3-77c79d5af43a is going to be updated. [ 889.354776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.355019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.355155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.355383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.355617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.355795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c00d3d7b-02be-46a8-a2a3-77c79d5af43a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.462204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.462458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.462544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.463106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.463106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.463106] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 889.508760] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.508956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.509048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.509441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.509743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.524582] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 889.722847] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3085df7e-1c09-4942-ba27-49d63274ac56 in Status: SUCCESS [ 889.724129] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 deletion is rescheduled due to dependency. [ 889.724330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.643436] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 890.643709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.643940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.644238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.644472] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.644605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.644676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.644836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.644919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.645028] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.795065] env[65427]: INFO networking_nsxv3.common.synchronization [req-5f48657a-0302-44c9-a1e9-e58a87aab319 req-932bf0e6-224a-42f0-82a5-87a1ca7ce25c tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 890.796491] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 890.796491] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.796491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.796491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.796491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.796994] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.796994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.796994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.797301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.797301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.797301] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.081989] env[65427]: INFO networking_nsxv3.common.synchronization [req-206861ba-1e13-43a7-9f9f-59e758202e40 req-4c86f6e9-e3d9-474e-ab64-d9a864a91b81 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 891.082781] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 891.086150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.086355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.086455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.086699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.086903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.087046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.087119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.087337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.087453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.087572] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.148788] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.302308] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.514901] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.515112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.515240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.515536] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.515847] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.516032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.516139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.516369] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.516524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.516809] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.516881] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.517054] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.517199] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.517412] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.517444] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.517592] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.539675] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.539927] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.540132] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.540382] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.540771] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.541691] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.541851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.542198] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.542444] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c89bbd5-7d49-4653-9a8e-beefafaf9cfd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.544043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 891.544249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.544655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.544840] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.544955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.545040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.545195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.545276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.545362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.545480] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.591889] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.651320] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.804179] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.048255] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.048527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.048656] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.048946] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.049145] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.049301] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd not found, creating... [ 892.049612] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.049793] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.049909] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.050205] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.050346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.050820] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.051056] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.051223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.051481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.052463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.052582] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd is going to be created. [ 892.053833] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.054147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.054147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.054247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.054385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.054495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.054569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.054720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.054828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.054883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.055101] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.055198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.055260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.055444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.055694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.055817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.055883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.056073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.056192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.056319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.056439] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.077094] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.077302] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.077492] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.077693] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.077930] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.078164] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.094702] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.154868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.155085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.155191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.155473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.155619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.155891] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 892.208744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.208917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.208917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.209252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.209578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.229577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 892.308427] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.308679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.308679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.308925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.309065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.309137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 892.348024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.348354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.348354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.348501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.348757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.360957] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 892.560435] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 892.580413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.580619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.580727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.581051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.581192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.581492] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.581650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.581750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.581978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.582121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.582413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.582558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.582657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.583101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.583101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.583303] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.583459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.583558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.583771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.583889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.584030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 892.598571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.598571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.598571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.598571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.598571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.598571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 892.630256] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.630449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.631195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.631195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.631195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.643225] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 892.653378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.653378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.653825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.653825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.653825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.674971] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 892.825316] env[65427]: INFO networking_nsxv3.common.synchronization [req-206861ba-1e13-43a7-9f9f-59e758202e40 req-2da7770d-9a92-44e0-9312-4610cd63db9a service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 892.827873] env[65427]: INFO networking_nsxv3.common.synchronization [req-206861ba-1e13-43a7-9f9f-59e758202e40 req-2da7770d-9a92-44e0-9312-4610cd63db9a service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 892.828154] env[65427]: INFO networking_nsxv3.common.synchronization [req-206861ba-1e13-43a7-9f9f-59e758202e40 req-2da7770d-9a92-44e0-9312-4610cd63db9a service nova] Enqueued Resource ID: 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd with Priority: HIGHEST for action port [ 892.830641] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 892.830641] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 892.830741] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd with Priority: HIGHEST for action port [ 892.832509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.832509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.832509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.832509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.832509] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.832509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.832509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.833071] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.833071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.833071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.833709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.833709] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c89bbd5-7d49-4653-9a8e-beefafaf9cfd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.336626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.336626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.341128] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd with status ACTIVE [ 893.341128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.341128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.341128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.341128] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c89bbd5-7d49-4653-9a8e-beefafaf9cfd is going to be updated. [ 893.368566] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.368566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c89bbd5-7d49-4653-9a8e-beefafaf9cfd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.754164] env[65427]: INFO networking_nsxv3.common.synchronization [req-20cadb66-56cb-474a-a4fd-f62acdc86591 req-2abe93b6-e76b-4328-a0e8-ca71f1e54b9d tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 893.754766] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 893.756836] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.756836] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.756836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.756836] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.123040] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.123040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.123040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.123040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.123040] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.123040] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.123917] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.124122] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.128294] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.128294] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.128294] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.128294] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.128294] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.128294] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 894.128294] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.128294] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.153357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.153702] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 894.154245] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.154245] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-601" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.154985] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-fce05eed-54e6-4c29-ab2a-fa488637c611 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.154985] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.155161] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.155550] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.158224] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fce05eed-54e6-4c29-ab2a-fa488637c611',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.239537] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 894.239804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.239983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.240254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.240459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.240580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.240661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.240820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.240917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.241021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.241116] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.258969] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.259130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.259201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.259427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.259518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.259725] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.259825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.259890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.260053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.260131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.260222] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 894.294129] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.294129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.294129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.294129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.294129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.302011] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 894.372460] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 894.372655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.655757] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 894.656034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.656239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.656478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.656706] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.657071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.657071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.657164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.657245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.657348] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.661851] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.661851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.661851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.661851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.661851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.661851] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port fce05eed-54e6-4c29-ab2a-fa488637c611 not found, creating... [ 894.662315] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.662315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.662315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.662625] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.662798] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.663911] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.664165] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.664361] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.664744] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.664810] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.665079] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: fce05eed-54e6-4c29-ab2a-fa488637c611 is going to be created. [ 894.693320] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.693320] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.693512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.695570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.695570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.695570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.697089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 894.697291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.743798] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.743798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.743798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.744098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.744171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.744272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.744340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.745042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.745042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.745042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.745042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.745437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.745437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.745437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.745437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.745932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.745932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.745932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.745932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.745932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.746187] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.161234] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.248590] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54fe1b7a-483b-4522-ab83-ced21005a9ad: rpc.has_security_group_logging(os_id): False [ 895.275970] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.276167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.276235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.276517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.276596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.277021] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.277174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.277246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.277442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.277565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.277832] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.278038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.278086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.282188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.282188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.282188] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 895.361902] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.362059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.362146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.363450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.363450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.379028] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 895.517539] env[65427]: INFO networking_nsxv3.common.synchronization [req-20cadb66-56cb-474a-a4fd-f62acdc86591 req-d189e2f0-54de-4655-9052-bed68faa5f4e service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 895.518560] env[65427]: INFO networking_nsxv3.common.synchronization [req-20cadb66-56cb-474a-a4fd-f62acdc86591 req-d189e2f0-54de-4655-9052-bed68faa5f4e service nova] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 895.518982] env[65427]: INFO networking_nsxv3.common.synchronization [req-20cadb66-56cb-474a-a4fd-f62acdc86591 req-d189e2f0-54de-4655-9052-bed68faa5f4e service nova] Enqueued Resource ID: fce05eed-54e6-4c29-ab2a-fa488637c611 with Priority: HIGHEST for action port [ 895.519911] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_rules [ 895.520294] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 895.520683] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fce05eed-54e6-4c29-ab2a-fa488637c611 with Priority: HIGHEST for action port [ 895.521392] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.522053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.522317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.522723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.523106] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.526076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.526398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.527023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-fce05eed-54e6-4c29-ab2a-fa488637c611 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.528130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.530020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.530020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.530020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fce05eed-54e6-4c29-ab2a-fa488637c611',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.647447] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 895.647543] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 895.648058] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 895.648209] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 895.648517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.648592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.648763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.648851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.649013] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.649302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.649416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.649629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.649742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.650060] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.651203] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.651451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.651451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.651667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.651851] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.651983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.652118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.652837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.652837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.652837] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.666699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.697515] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_rules [ 895.697712] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 895.697852] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 895.697982] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 895.698124] env[65427]: INFO networking_nsxv3.common.synchronization [req-ec72b1e0-3ee6-4872-9378-8fb2b8b0b043 req-87658142-a0bd-4341-816a-9e441f9a0912 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 895.699227] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_rules [ 895.699413] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 895.699575] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 895.699811] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 895.699870] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 895.700320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.700480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.700576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.701151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.701301] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.702984] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.703195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.703275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.703464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.703545] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.705681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.705681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.705681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.705681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.705681] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.706388] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.706517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.706786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.706907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.033315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.033965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.033965] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fce05eed-54e6-4c29-ab2a-fa488637c611 with status ACTIVE [ 896.033965] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.033965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.033965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.034224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.034302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.034457] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.034586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.034653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.034812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.034891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.035467] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.035588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.035685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.035950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.036070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.036165] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fce05eed-54e6-4c29-ab2a-fa488637c611 is going to be updated. [ 896.060346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.061038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.061038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.061038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.061038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.061038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fce05eed-54e6-4c29-ab2a-fa488637c611" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.157443] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.159483] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.168632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.168991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.168991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.169267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.169449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.169629] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 896.208384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with status ACTIVE [ 896.208768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.208949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.209038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.209495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.209495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.209810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.209915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.210057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.210299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.210429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.210648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.210801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.210906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.211110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.211222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.211376] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc is going to be updated. [ 896.212970] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.213121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.213474] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.213617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.226273] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.226531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.226705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.226911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.227125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.244280] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 896.248355] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.248493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.248566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.248797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.248944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.249239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.315143] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 896.315373] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f deletion is rescheduled due to dependency. [ 896.315530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.315708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.315927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.316135] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.316254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.316338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.316475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.316563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.316651] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.664658] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.665790] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.676920] env[65427]: INFO networking_nsxv3.common.synchronization [req-6ac25a9d-abe2-46ae-8782-3186ab065925 req-31b2dbb5-bb06-4115-9549-d75b5a67b1ec tempest-ServersNegativeTestJSON-726626064 tempest-ServersNegativeTestJSON-726626064-project-member] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 896.677523] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 896.677866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.678223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.678588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.678682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.678808] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.679226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.679226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.679337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.679439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.679639] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.820111] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.104751] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.105484] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.105484] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.105922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.106258] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.106445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.106566] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.106941] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.107210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.107449] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.107592] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.107706] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.107820] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.107934] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.108058] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.108197] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.130427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.130640] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.130799] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.131114] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.131364] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-158517b8-96e5-4777-979d-e589128cc5c7 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.131612] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.132482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.132482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.132482] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158517b8-96e5-4777-979d-e589128cc5c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.168063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.168254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.168364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.168568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.168660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.168889] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be created. [ 897.170277] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.170448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.170562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.170762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.170874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.170998] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 897.182517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.182961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.182961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.183094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.183124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.183335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.183448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.183484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.183653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.183730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.183817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 already deleted. [ 897.183898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.201651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.201651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.201651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.201651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.202182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.205271] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.205441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.205552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.205842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.206056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.217817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 897.218710] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: UNINITIALIZED for 2s [ 897.322729] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.395075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 897.395320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.635082] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.635365] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.635506] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.635873] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.636038] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.636207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 158517b8-96e5-4777-979d-e589128cc5c7 not found, creating... [ 897.636491] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.636633] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.636838] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.636980] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.637135] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.637429] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.637604] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.637697] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.637905] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.638053] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.638196] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 158517b8-96e5-4777-979d-e589128cc5c7 is going to be created. [ 897.664288] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.664405] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.664621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.664895] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.665148] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.665387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.824949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.825251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.825251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.825422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.825516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.825657] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 897.859920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.860102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.860191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.860415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.860562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.871687] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 898.254130] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 898.254448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.254658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.254922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.255153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.255277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.255343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.255522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.255614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.255697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.255790] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.452224] env[65427]: INFO networking_nsxv3.common.synchronization [req-6ac25a9d-abe2-46ae-8782-3186ab065925 req-408d4c1b-7755-4041-a832-f6c3410e9793 service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 898.452440] env[65427]: INFO networking_nsxv3.common.synchronization [req-6ac25a9d-abe2-46ae-8782-3186ab065925 req-408d4c1b-7755-4041-a832-f6c3410e9793 service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 898.452576] env[65427]: INFO networking_nsxv3.common.synchronization [req-6ac25a9d-abe2-46ae-8782-3186ab065925 req-408d4c1b-7755-4041-a832-f6c3410e9793 service nova] Enqueued Resource ID: 158517b8-96e5-4777-979d-e589128cc5c7 with Priority: HIGHEST for action port [ 898.453157] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 898.453363] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 898.453411] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158517b8-96e5-4777-979d-e589128cc5c7 with Priority: HIGHEST for action port [ 898.453732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.453859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.453928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.454194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.454280] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.455299] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.455454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.455524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.455703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.455919] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.456055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.456122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.456281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.456388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.456488] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.457700] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-158517b8-96e5-4777-979d-e589128cc5c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.457700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.457700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.457700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.457952] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158517b8-96e5-4777-979d-e589128cc5c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.763025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.763025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.763025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.763025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.763025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.763793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.763793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.763793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.763793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.763793] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.960041] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.961114] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.961867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.961867] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 158517b8-96e5-4777-979d-e589128cc5c7 with status ACTIVE [ 898.961867] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.962061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.962094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.962354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.963067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.965387] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.965572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.965671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.965910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.966014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.966301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.966417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.966485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.966748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.966875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.966912] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 158517b8-96e5-4777-979d-e589128cc5c7 is going to be updated. [ 899.003939] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.004116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.004176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.004740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.004863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.005121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.230923] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: UNINITIALIZED for 4s [ 899.231710] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 4s [ 899.265886] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 899.287383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.287568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.287741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.288100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.288338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.288763] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.288941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.289099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.289312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.289470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.289759] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.289887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.289949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.290270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.290395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.291023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.291023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.291023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.291312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.291407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.291589] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 899.370348] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.370569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.370650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.370947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.371173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.386128] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 899.462680] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.881942] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 899.882202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.882483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.882631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.882838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.883027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.883027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.883172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.883260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.883345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.883417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.965621] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.965702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.965760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.965996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.966156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.966244] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be created. [ 900.007678] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.007678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.007678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.007678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.007678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.026400] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: UNINITIALIZED for 2s [ 900.386678] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.387047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.387047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.387284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.387482] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.387626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.387784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.388056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.388163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.388261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.388437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.388535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.388601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.388775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.389047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.389227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.389315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.389469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.389552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.389639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.389734] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.895332] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc0cbb36-d62c-40ce-9e79-61f04e36627f: rpc.has_security_group_logging(os_id): False [ 900.918998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.919191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.919267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.919487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.919581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.919812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.919914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.919970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.920170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.920223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.920418] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.920514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.920578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.920729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.920827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.921121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.921272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.921461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.921507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.921609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.921726] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 901.000749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.000944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.001038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.001258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.001374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.025226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 901.248025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.248025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.248025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.248025] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.248683] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: SUCCESS [ 901.248683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.248683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.248854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.249032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.249156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.249219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.249384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.249460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.249614] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.410251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 901.410509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.667841] env[65427]: INFO networking_nsxv3.common.synchronization [req-1fd853c8-4fad-4235-8f89-24041740617d req-b73c95e3-d9d6-458b-9449-e2f18d17196a tempest-InstanceActionsNegativeTestJSON-562136953 tempest-InstanceActionsNegativeTestJSON-562136953-project-member] Enqueued Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 901.668496] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 901.669562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.669951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.669951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.670079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.670410] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.670410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.670410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.670614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.670700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.670799] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.751346] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.752557] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.037637] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 902.037637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.037637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.037948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.037995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.038122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.038188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.038419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.038419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.039060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.039060] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.055061] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.055319] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.055451] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.055829] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.057371] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.057577] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.057703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.057970] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.058165] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.058389] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.058503] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.058616] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.058723] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.058844] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.058949] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.059102] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.081191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.081457] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.081611] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.081703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.082636] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-c191537b-25e9-4d49-9113-630a34ee48d6 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.082636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.082636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.082887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.082922] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c191537b-25e9-4d49-9113-630a34ee48d6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.172828] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.173064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.173113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.173329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.173419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.173634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.173733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.173795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.173948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.174035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.174792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 already deleted. [ 902.174792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.256462] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.257178] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.541570] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.541910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.541910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.542057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.542275] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.542414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.542490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.542656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.542749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.542943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.543124] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.543218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.543276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.543421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.543563] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.544565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.544565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.544565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.544565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.544565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.544565] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.587116] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.587420] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.587598] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.587960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.588211] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.588484] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port c191537b-25e9-4d49-9113-630a34ee48d6 not found, creating... [ 902.588962] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.589203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.589355] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.589705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.589924] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.590305] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.590567] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.590722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.591046] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.591204] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.591376] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: c191537b-25e9-4d49-9113-630a34ee48d6 is going to be created. [ 902.615737] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.616364] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.616364] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.616494] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.616752] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.616984] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.696016] env[65427]: INFO networking_nsxv3.common.synchronization [req-a368cff5-73c2-488f-8e8f-b113006e6020 req-79f13235-2e25-489f-b10a-952e1555b74b tempest-ListServerFiltersTestJSON-131402197 tempest-ListServerFiltersTestJSON-131402197-project-member] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 902.696675] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGHEST for action security_group_members [ 902.697076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.697258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.697330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.697558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.697756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.697865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.697917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.698143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.698234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.698335] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.762963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.763121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.763121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.763379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.763464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.763571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 902.765182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.765437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.765542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.765691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.765780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.765894] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be updated. [ 902.805847] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.806103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.806103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.806376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.806545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.809398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.809690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.809690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.809801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.809962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.821718] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 902.822624] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: IN_PROGRESS for 2s [ 903.044357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 903.044357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.046226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b945fd5-1333-4892-be63-1784a8a66349: rpc.has_security_group_logging(os_id): False [ 903.073035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.073035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.073035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.073035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.073615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.076117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.076117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.076117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.076117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.076117] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be created. [ 903.138215] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.138409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.138449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.138637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.140141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.151898] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 903.200651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.200866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.200983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.201327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.201459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.201651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.201754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.201818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.201980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.202076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.202165] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be updated. [ 903.230756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.230756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.230756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.230987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.231125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.244447] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: IN_PROGRESS for 2s [ 903.265768] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 903.266061] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 903.266061] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 903.266618] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 903.266757] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 903.266878] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 903.267496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7d641d-a982-456c-9da8-1e02e88ea9ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.267730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.267730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.267958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.268139] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.268253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.268311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.268482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.268576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.268696] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.271508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.271626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.271898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.271898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.317719] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_rules [ 903.317894] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 903.318046] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_rules [ 903.318181] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 903.318306] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 903.318431] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 903.318556] env[65427]: INFO networking_nsxv3.common.synchronization [req-02fb7489-e5ac-457f-b4b5-55aaaa71af47 req-357c4748-4dee-4cb0-8930-853118936cfa tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 903.319130] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_rules [ 903.319267] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_rules [ 903.319363] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 903.319456] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with Priority: HIGHEST for action port [ 903.319546] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_rules [ 903.319636] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 903.319723] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 903.320011] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.320122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.320354] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7d641d-a982-456c-9da8-1e02e88ea9ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.320410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.320471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.320734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.320834] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.321742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.322059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.322059] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.322197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.322229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.322413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.322491] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.324490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.324490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.324490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.324490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.324490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7d641d-a982-456c-9da8-1e02e88ea9ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.324490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.367671] env[65427]: INFO networking_nsxv3.common.synchronization [req-1fd853c8-4fad-4235-8f89-24041740617d req-7199cfb2-da59-415d-9ced-26f42773d161 service nova] Enqueued Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_rules [ 903.367883] env[65427]: INFO networking_nsxv3.common.synchronization [req-1fd853c8-4fad-4235-8f89-24041740617d req-7199cfb2-da59-415d-9ced-26f42773d161 service nova] Enqueued Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 903.368081] env[65427]: INFO networking_nsxv3.common.synchronization [req-1fd853c8-4fad-4235-8f89-24041740617d req-7199cfb2-da59-415d-9ced-26f42773d161 service nova] Enqueued Resource ID: c191537b-25e9-4d49-9113-630a34ee48d6 with Priority: HIGHEST for action port [ 903.368862] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_rules [ 903.369021] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 903.369125] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c191537b-25e9-4d49-9113-630a34ee48d6 with Priority: HIGHEST for action port [ 903.369444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.369603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.369757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.370119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.370119] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.372168] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.372332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.372413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.372853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.373085] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.373166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.373223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.373793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.373793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.373793] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.375466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c191537b-25e9-4d49-9113-630a34ee48d6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.375466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.375466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.375466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.375466] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c191537b-25e9-4d49-9113-630a34ee48d6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.773017] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.826448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7d641d-a982-456c-9da8-1e02e88ea9ba taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.826611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.826845] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc with status ACTIVE [ 903.827071] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.827157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.827280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.827460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.827607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.827837] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.827976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.828024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.828182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.828264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.828446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.828541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.828600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.828745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.828849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.828884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc is going to be updated. [ 903.853704] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.853854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.853925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.854150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.854305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.854534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ac31f4-7c0a-47d6-b7ee-6e11a479ddbc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.877875] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.878080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.878235] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.879479] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c191537b-25e9-4d49-9113-630a34ee48d6 with status ACTIVE [ 903.881368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.881519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.881593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.881817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.882817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.885286] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.885286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.885449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.885672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.885672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.885854] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.885959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.886050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.886232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.886311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.886490] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c191537b-25e9-4d49-9113-630a34ee48d6 is going to be updated. [ 903.918597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.918797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.918869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.919108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.919258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.919427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c191537b-25e9-4d49-9113-630a34ee48d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.278016] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.388778] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.780810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.781130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.781130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.781352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.781480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.781610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba is going to be created. [ 904.806563] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.806894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.807075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.807366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.807618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.818170] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba in Status: UNINITIALIZED for 2s [ 904.842983] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 904.842983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.843460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.843460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.843625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.843745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.843809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.843970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.844596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.844596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.844596] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.846462] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: SUCCESS [ 904.846462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.846587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.847588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.847588] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.847588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.847588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.847588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.847588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.847588] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.849046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.849046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.849046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.849046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.849046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.849294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.849477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.849477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.849618] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.850684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.850844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.852625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.852625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.852625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.852625] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.891349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.891532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.891600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.892095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.892216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.892337] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 is going to be created. [ 904.922333] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.922333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.922333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.922580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.922726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.940716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: UNINITIALIZED for 2s [ 905.170063] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 905.170379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.253902] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 in Status: SUCCESS [ 905.254115] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 deletion is rescheduled due to dependency. [ 905.254227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.352940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.353032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.353232] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.354509] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.355876] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.859168] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.859593] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143af032-afd2-49c3-a074-e2cb406d3a73: rpc.has_security_group_logging(os_id): False [ 905.864031] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.888029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.888236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.888313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.888545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.888634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.889171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.889346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.889640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.889776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.890119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.890194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be created. [ 905.959181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.959491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.964018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.964018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.964018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.976557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: IN_PROGRESS for 2s [ 906.367845] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.367845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.367845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.367845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.367845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.367845] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 906.369804] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.370176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.371043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.371824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.372098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.372366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be updated. [ 906.404086] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.404265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.404308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.404562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.404717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.407221] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.407428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.407538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.407768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.408079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.421357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 906.422284] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: IN_PROGRESS for 2s [ 906.762738] env[65427]: INFO networking_nsxv3.common.synchronization [req-258cc14c-b0c1-42a1-b17b-33666bc7ec9a req-1191280e-b3aa-4290-81ed-212c91517e51 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 906.762909] env[65427]: INFO networking_nsxv3.common.synchronization [req-258cc14c-b0c1-42a1-b17b-33666bc7ec9a req-1191280e-b3aa-4290-81ed-212c91517e51 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 906.763062] env[65427]: INFO networking_nsxv3.common.synchronization [req-258cc14c-b0c1-42a1-b17b-33666bc7ec9a req-1191280e-b3aa-4290-81ed-212c91517e51 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 906.763651] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba with Priority: HIGHEST for action security_group_members [ 906.763790] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143af032-afd2-49c3-a074-e2cb406d3a73 with Priority: HIGHEST for action security_group_members [ 906.763998] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 906.767732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7d641d-a982-456c-9da8-1e02e88ea9ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.767732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.767732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-143af032-afd2-49c3-a074-e2cb406d3a73 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.767732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.767732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.767732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.830289] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba in Status: SUCCESS [ 906.830289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.830289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.830289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.830289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.830737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.831713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.831713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.831713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.831713] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.951870] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: SUCCESS [ 906.952237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.952748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.952968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.953176] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.953292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.953372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.953508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.953641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.953703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.953802] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.334885] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.335773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.336078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.336078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.336460] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba is going to be deleted. [ 907.373130] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.373287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.373342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.373567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.373655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.373775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.373975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.374206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.376543] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.376543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.376543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.376543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.376543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.376543] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.457932] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.458155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.458155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.459056] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.459056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.459362] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.459362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.459362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.459513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.459609] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.461169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.461319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.465385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.465499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.465615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.465727] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.806400] env[65427]: INFO networking_nsxv3.common.synchronization [req-baf399ea-aba4-48f3-914a-92e671922448 req-bde49043-92d6-4fb0-b00e-0a04a5135e5a tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 907.807245] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 907.807695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.807822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.807958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.808163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.808375] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.808489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.808580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.808837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.808985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.809067] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.877271] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.877402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.877485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.877928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.878096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.878436] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.878611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.878682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.878865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.879116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.879116] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba already deleted. [ 907.879116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.879349] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.880374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.881675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.881675] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.881816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.882260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.882897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.884044] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.970035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8a63f06-9975-49cd-b7a4-1fc94db58876: rpc.has_security_group_logging(os_id): False [ 907.991433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.991433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.991433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.991433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.992182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.992502] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.992716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.992864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.993120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.993299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.993477] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 is going to be created. [ 907.995824] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: SUCCESS [ 907.996144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.996803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.997211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.997433] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.061857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.061857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.061857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.062242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.063120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.078377] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: IN_PROGRESS for 2s [ 908.311232] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.385258] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e7d641d-a982-456c-9da8-1e02e88ea9ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.387338] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.390933] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.390933] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba already deleted. [ 908.390933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.436033] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143af032-afd2-49c3-a074-e2cb406d3a73 in Status: SUCCESS [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.436033] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.436033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.436033] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.438678] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 908.439190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.439451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.441986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.441986] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.524736] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.524895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.525056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.525242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.525334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.525442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be deleted. [ 908.579515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.579515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.579515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.579701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.579792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.579930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.814651] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.891994] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e7d641d-a982-456c-9da8-1e02e88ea9ba: rpc.has_security_group_logging(os_id): False [ 908.911729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.912154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.912512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.914049] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.914049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.914049] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba is going to be created. [ 908.938500] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba], does not exist path=[/infra/domains/default/groups/6e7d641d-a982-456c-9da8-1e02e88ea9ba]."\n}' [ 908.938740] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba [ 908.938840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 908.944059] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.944192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.944260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.944471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.944620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.944819] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.944919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.944984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.945296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.945411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.945569] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 is going to be deleted. [ 908.946976] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.979232] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.979669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.979669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.979669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.979773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.979832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.979997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.980224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.980396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.980499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.980565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.980706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.980783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.980877] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143af032-afd2-49c3-a074-e2cb406d3a73',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.984227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.984874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.985066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.985300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.986854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.987084] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.987249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.987348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.987612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.987729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.988078] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.988154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.991999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.991999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.991999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.991999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7d641d-a982-456c-9da8-1e02e88ea9ba is going to be created. [ 909.014632] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba], does not exist path=[/infra/domains/default/groups/6e7d641d-a982-456c-9da8-1e02e88ea9ba]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba [ 909.014826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7d641d-a982-456c-9da8-1e02e88ea9ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.015091] env[65427]: Traceback (most recent call last): [ 909.015129] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 909.015129] env[65427]: return func(*args, **kwargs) [ 909.015129] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 909.015129] env[65427]: res.raise_for_status() [ 909.015129] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 909.015129] env[65427]: raise HTTPError(http_error_msg, response=self) [ 909.015129] env[65427]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba [ 909.015129] env[65427]: During handling of the above exception, another exception occurred: [ 909.015129] env[65427]: Traceback (most recent call last): [ 909.015374] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 909.015374] env[65427]: listener.cb(fileno) [ 909.015374] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 909.015374] env[65427]: result = function(*args, **kwargs) [ 909.015374] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 909.015374] env[65427]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 909.015374] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 909.015374] env[65427]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 909.015374] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 909.015374] env[65427]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 909.015374] env[65427]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 909.015374] env[65427]: res.raise_for_status() [ 909.015374] env[65427]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 909.015374] env[65427]: raise HTTPError(http_error_msg, response=self) [ 909.015374] env[65427]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6e7d641d-a982-456c-9da8-1e02e88ea9ba [ 909.015374] env[65427]: Removing descriptor: 15 [ 909.318543] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.319169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.319169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.319950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.320898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.320898] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 909.360810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.360969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.361874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.362912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.362912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.380779] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 909.451476] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.493266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.493266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.493266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.493719] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143af032-afd2-49c3-a074-e2cb406d3a73 already deleted. [ 909.493719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143af032-afd2-49c3-a074-e2cb406d3a73" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.787742] env[65427]: INFO networking_nsxv3.common.synchronization [req-d55e1911-fb4d-41b5-8989-5d2c95cf50ba req-edfd7cec-e9cf-4977-bb60-397b4b5fd77e tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 909.788437] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 909.789341] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.789500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.789667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.789747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.790188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.790188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.790188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.790532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.790532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.790532] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.904425] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0f19628c-b3c3-464f-8dce-afea2616c42d tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 909.904518] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 909.904899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.905225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.905320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.905604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.905783] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.955420] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.955420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.955420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.955776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.955776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.955841] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 909.998097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.998097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.998097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.998567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.998567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.013251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 910.059641] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0119f5d9-90c8-44bb-a8f0-76398a92411d tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 910.060418] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 910.061570] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.061570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.101083] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: SUCCESS [ 910.103021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.293732] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.429536] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.429536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 already deleted. [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.429536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.429536] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.796081] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.857988] env[65427]: INFO networking_nsxv3.common.synchronization [req-3f06552a-8e74-4389-9fd4-d9cce25976c5 req-14b68f42-4639-4c70-aca6-cddf5b3a14e9 tempest-ImagesOneServerNegativeTestJSON-607357529 tempest-ImagesOneServerNegativeTestJSON-607357529-project-member] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 910.858907] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGHEST for action security_group_members [ 910.859571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.859704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.859773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.860063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.860162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.860261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.861248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.861438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.861529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.861632] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.953656] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.953998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.954118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.954492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.954639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.954785] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 already deleted. [ 910.954912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.305405] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.305405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.305405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.305405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.305405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.305405] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 911.336065] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.336221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.336292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.336493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.336638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.348482] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 911.366157] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.366157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.366157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.366157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.393035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.393035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.393035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.393035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.393035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.393035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.393035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be updated. [ 911.395922] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 911.395922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.428986] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.429193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.429269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.429618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.429711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.439866] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: IN_PROGRESS for 2s [ 911.850594] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5ad4ced2-233b-4538-bd4e-25c88f8adace None None] Enqueued Resource ID: 94e48e1d-ff5b-4a80-9ef6-16d794bd8e47 with Priority: HIGHEST for action port [ 911.854796] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e48e1d-ff5b-4a80-9ef6-16d794bd8e47 with Priority: HIGHEST for action port [ 911.855332] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e48e1d-ff5b-4a80-9ef6-16d794bd8e47 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.855475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e48e1d-ff5b-4a80-9ef6-16d794bd8e47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.855551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e48e1d-ff5b-4a80-9ef6-16d794bd8e47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.855853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e48e1d-ff5b-4a80-9ef6-16d794bd8e47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.856080] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e48e1d-ff5b-4a80-9ef6-16d794bd8e47',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.026166] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 912.026166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.026166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.026441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.028298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.028298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.029021] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.029844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.030340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.030489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.030594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.030663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.030839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.030890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.030976] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.360615] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94e48e1d-ff5b-4a80-9ef6-16d794bd8e47 [ 912.360615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.360615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.360615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.360978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.360978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.360978] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94e48e1d-ff5b-4a80-9ef6-16d794bd8e47 already deleted. [ 912.361073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e48e1d-ff5b-4a80-9ef6-16d794bd8e47" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.535025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 912.535025] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.555983] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.556147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.556211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.556421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.577819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.578116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.578239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.578307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.578564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.578684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.578903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.579788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.579856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.580057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.580149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.580364] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.580462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.580525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.580670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.580747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.580833] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 912.655408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.655408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.655408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.655408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.655408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.672132] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 913.037102] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.359774] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 913.360066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.454192] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f in Status: SUCCESS [ 913.454192] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f deletion is rescheduled due to dependency. [ 913.454192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.540609] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.540609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.540609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.540609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.540609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.540609] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 913.570960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.571619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.571619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.571619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.571619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.581200] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 914.090303] env[65427]: INFO networking_nsxv3.common.synchronization [None req-648bd7ec-2fe6-4000-be32-0820723106e5 None None] Enqueued Resource ID: f58e8036-5154-41f4-9a72-272dde0b0166 with Priority: HIGHEST for action port [ 914.091153] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58e8036-5154-41f4-9a72-272dde0b0166 with Priority: HIGHEST for action port [ 914.091476] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f58e8036-5154-41f4-9a72-272dde0b0166 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.091636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f58e8036-5154-41f4-9a72-272dde0b0166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.092235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f58e8036-5154-41f4-9a72-272dde0b0166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.092235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f58e8036-5154-41f4-9a72-272dde0b0166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.092235] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f58e8036-5154-41f4-9a72-272dde0b0166',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.595599] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f58e8036-5154-41f4-9a72-272dde0b0166 [ 914.596025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.596142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.596184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.596408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.596488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.596593] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f58e8036-5154-41f4-9a72-272dde0b0166 already deleted. [ 914.596854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f58e8036-5154-41f4-9a72-272dde0b0166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.694702] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 914.695123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.695252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.695599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.695723] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.199407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.199407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.215217] env[65427]: INFO networking_nsxv3.common.synchronization [req-6c41175e-895f-4c5f-baee-3438a31b2dc5 req-972af7d5-3100-4da7-95de-5e7ec1c90a28 tempest-InstanceActionsNegativeTestJSON-562136953 tempest-InstanceActionsNegativeTestJSON-562136953-project-member] Enqueued Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 915.215934] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGHEST for action security_group_members [ 915.216316] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.216810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.216892] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.217116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.217281] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.217388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.217452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.217604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.217694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.217797] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.592325] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 915.592974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.592974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.593249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.593249] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.593426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.593426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.593971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.593971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.593971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.593971] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.722040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.722040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.722040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.722457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.745396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.745396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.745396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.745745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.745745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.745745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.745972] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 is going to be updated. [ 915.792900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.793076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.793150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.793367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.793516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.806200] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: IN_PROGRESS for 2s [ 916.095860] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.096049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.096123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.096348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.096523] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.096625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.096692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.096842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.096931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.097037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.097186] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.097277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.097339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.097487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.097626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.097716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.097777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.098062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.098194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.098230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.098331] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.601136] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe90e39-abbd-4d07-9021-eedecd7a9539: rpc.has_security_group_logging(os_id): False [ 916.621032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.621032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.621032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.621582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.621787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.622178] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.622434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.622754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.623068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.623269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.623657] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.623891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.624070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.624371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.625137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.625535] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 916.692192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.692469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.692579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.692854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.693108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.712451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 916.858781] env[65427]: INFO networking_nsxv3.common.synchronization [req-6b1a73d4-c66e-484f-bee0-f4abe886ea28 req-cad147c0-f9db-4175-b640-059aa81fb5f5 tempest-ServerGroupTestJSON-10039536 tempest-ServerGroupTestJSON-10039536-project-member] Enqueued Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 916.859332] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 916.859982] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.860124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.860196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.860785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.860967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.861084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.861151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.861313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.861400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.861531] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.193529] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.193735] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.193856] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.194303] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.194625] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.194821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.194946] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.195334] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.195503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.195757] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.195898] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.196057] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.196195] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.196316] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.196483] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.196672] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.225482] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.226020] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.226020] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.226172] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-953" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.226987] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-d3932e72-083a-458b-a16c-090d2e996963 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.226987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.226987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.227235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.227983] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3932e72-083a-458b-a16c-090d2e996963',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.364035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.364217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.364292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.364517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.364668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.364889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.364992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.365069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.365223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.365301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.365387] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad already deleted. [ 917.365468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.729757] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.729870] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.730471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.731244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.731244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.731426] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port d3932e72-083a-458b-a16c-090d2e996963 not found, creating... [ 917.735021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.735021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.735021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.735620] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: d3932e72-083a-458b-a16c-090d2e996963 is going to be created. [ 917.755188] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.756032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.756032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.756032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.756183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.756316] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.831731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 in Status: SUCCESS [ 917.831731] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 deletion is rescheduled due to dependency. [ 917.831731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [req-6b1a73d4-c66e-484f-bee0-f4abe886ea28 req-93b069de-86f8-4ab9-8925-ae81abfda1c9 service nova] Enqueued Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_rules [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [req-6b1a73d4-c66e-484f-bee0-f4abe886ea28 req-93b069de-86f8-4ab9-8925-ae81abfda1c9 service nova] Enqueued Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [req-6b1a73d4-c66e-484f-bee0-f4abe886ea28 req-93b069de-86f8-4ab9-8925-ae81abfda1c9 service nova] Enqueued Resource ID: d3932e72-083a-458b-a16c-090d2e996963 with Priority: HIGHEST for action port [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_rules [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 918.476675] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3932e72-083a-458b-a16c-090d2e996963 with Priority: HIGHEST for action port [ 918.477287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.477287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.477383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.477971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.477971] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.480258] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.480386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.480452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.480618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.480771] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.480869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.480930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.482852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.483032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.483093] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.484396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3932e72-083a-458b-a16c-090d2e996963 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.484396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.484396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.484396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.484396] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3932e72-083a-458b-a16c-090d2e996963',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.736108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 918.736108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.980295] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.980490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.988199] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.989204] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3932e72-083a-458b-a16c-090d2e996963 with status ACTIVE [ 918.989302] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.989458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.989518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.990398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.990398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.990756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.990756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.990756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.990756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.990959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.990959] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3932e72-083a-458b-a16c-090d2e996963 is going to be updated. [ 919.027528] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.027528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.027528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.027528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.027528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.027793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3932e72-083a-458b-a16c-090d2e996963" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.493635] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.996784] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.996996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.997092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.997428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.997728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.998362] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad is going to be created. [ 920.024373] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.024593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.024593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.024871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.025048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.035528] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: UNINITIALIZED for 2s [ 920.593737] env[65427]: INFO networking_nsxv3.common.synchronization [req-6d4eeee5-d496-4d43-99b2-0055fa42eb87 req-99538776-9d61-46bc-b607-a46afdb991c0 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 920.594359] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 920.594863] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.594863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.595042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.595117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.595293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.595444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.595528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.595702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.595828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.595924] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.898399] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.898553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.898755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.899227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.899756] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.899994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.900179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.900432] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.900611] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.900851] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.900996] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.901171] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.901378] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.901534] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.901649] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.901786] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.920525] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.920737] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.920927] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.921129] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.922119] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.922119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.922119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.922392] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.922544] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ed8629-de92-4c21-bf9f-37cb7e9f5a40',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.098301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.098301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.098455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.098805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.120030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.120030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.120030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.120030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.120030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.120257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.120257] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 921.148655] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.149651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.149651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.149651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.149651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.159539] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 921.425098] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.425366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.425498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.425821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.425970] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.426137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 not found, creating... [ 921.426400] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.426557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.426676] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.426905] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.427087] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.427374] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.427524] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.427695] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.427845] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.427979] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.428164] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 is going to be created. [ 921.449382] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.449649] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.449724] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.450023] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.450244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.450489] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.046436] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: SUCCESS [ 922.046706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.046984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.047255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.047490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.047603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.047848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.047848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.047957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.048039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.048268] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.206130] env[65427]: INFO networking_nsxv3.common.synchronization [req-6d4eeee5-d496-4d43-99b2-0055fa42eb87 req-6c6b7eb7-da79-48b4-a5de-5f28e859abfe service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 922.206361] env[65427]: INFO networking_nsxv3.common.synchronization [req-6d4eeee5-d496-4d43-99b2-0055fa42eb87 req-6c6b7eb7-da79-48b4-a5de-5f28e859abfe service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 922.206582] env[65427]: INFO networking_nsxv3.common.synchronization [req-6d4eeee5-d496-4d43-99b2-0055fa42eb87 req-6c6b7eb7-da79-48b4-a5de-5f28e859abfe service nova] Enqueued Resource ID: 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 with Priority: HIGHEST for action port [ 922.207185] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 922.207307] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 922.207632] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 with Priority: HIGHEST for action port [ 922.207718] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.207944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.207944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.208230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.208230] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.210421] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.210533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.211198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.211319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.211682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.211682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.211682] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80ed8629-de92-4c21-bf9f-37cb7e9f5a40',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.550700] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.550987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.550987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.551192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.551375] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.551481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.551569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.551815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.551916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.552015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.552170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.552353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.552353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553033] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.553033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.553294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.553294] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.711096] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.711339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.713618] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 with status ACTIVE [ 922.713808] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.713928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.713998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.714231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.714420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.714490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.714590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.714705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.714873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.714954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.715154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.715253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.715316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.715457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.715532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.715695] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80ed8629-de92-4c21-bf9f-37cb7e9f5a40 is going to be updated. [ 922.739366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.739556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.739624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.739819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.739964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.740142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80ed8629-de92-4c21-bf9f-37cb7e9f5a40" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.056222] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f87de95f-23bb-4bc4-a0d9-8c1ba39407ad: rpc.has_security_group_logging(os_id): False [ 923.076253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.076420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.076458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.076667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.076761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.077029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.077128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.077128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.077292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.077371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.077567] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.077664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.077729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.077867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.077943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.078139] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.078232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.078295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.078432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.078507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.078593] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad is going to be created. [ 923.146506] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.146650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.146650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.146907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.147199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.162533] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: IN_PROGRESS for 2s [ 923.174924] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 923.174924] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 923.174924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.174924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.175121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.175453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.175453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.175453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.175772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.175772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.175772] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.261950] env[65427]: INFO networking_nsxv3.common.synchronization [req-1839c7bc-d927-495a-9532-cc7c1df2f60b req-695699ea-024d-4a70-acea-d7085b299af5 tempest-ServersTestBootFromVolume-683815655 tempest-ServersTestBootFromVolume-683815655-project-member] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 923.262778] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 923.263161] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.263300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.263839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.263839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.263976] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.263976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.264942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.264942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.264942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.264942] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.645257] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.645461] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-485" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.645651] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-485" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.646085] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-485" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.646461] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.646634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.646764] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.647011] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.647163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.647361] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.647475] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.647598] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.647783] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.647926] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.648060] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.648226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.675042] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.675042] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.675042] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.675042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-485" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.675327] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.675499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.675618] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.675954] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.676111] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b25c19-d7cf-441f-ac81-2d7ded3c97c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.679800] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.766551] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.766717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.766790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.767045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.767155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.767372] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.767472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.767540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.767706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.767798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.767905] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 already deleted. [ 923.767992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.178460] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.178915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.178915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.179301] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.179503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.179726] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 not found, creating... [ 924.180115] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.180333] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.180514] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.180822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.181072] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.181516] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.181765] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.182015] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.182341] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.182543] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.182767] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 is going to be created. [ 924.184355] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.210693] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.210972] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.211129] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.211440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.211686] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.211932] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.688217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.688217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.688431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.688524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.688602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.688725] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 924.717561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.717715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.717790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.718029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.718178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.727286] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 924.913074] env[65427]: INFO networking_nsxv3.common.synchronization [req-1839c7bc-d927-495a-9532-cc7c1df2f60b req-50cfcf03-d529-4ded-8ac1-ad9afff23e30 service nova] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 924.913228] env[65427]: INFO networking_nsxv3.common.synchronization [req-1839c7bc-d927-495a-9532-cc7c1df2f60b req-50cfcf03-d529-4ded-8ac1-ad9afff23e30 service nova] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 924.913369] env[65427]: INFO networking_nsxv3.common.synchronization [req-1839c7bc-d927-495a-9532-cc7c1df2f60b req-50cfcf03-d529-4ded-8ac1-ad9afff23e30 service nova] Enqueued Resource ID: 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 with Priority: HIGHEST for action port [ 924.913908] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_rules [ 924.916127] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 924.916287] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 with Priority: HIGHEST for action port [ 924.916606] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.916734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.916802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.917020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.917108] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.918450] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.918450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.918450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.918602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.918762] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.918856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.918923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.919954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.919954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.919954] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.920569] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.920569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.920569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.920569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.920723] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b25c19-d7cf-441f-ac81-2d7ded3c97c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.177725] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: SUCCESS [ 925.178475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.422910] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.422910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.423415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.423876] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 with status ACTIVE [ 925.424902] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.424902] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.424902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.425391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.425391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.425542] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.425628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.425714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.425888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.426211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.426211] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77b25c19-d7cf-441f-ac81-2d7ded3c97c7 is going to be updated. [ 925.449932] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.450114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.450284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.450464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.450554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.450705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b25c19-d7cf-441f-ac81-2d7ded3c97c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.928795] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.133019] env[65427]: INFO networking_nsxv3.common.synchronization [None req-cd356999-54a1-4c78-82b2-214a1dc8bcf9 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 with Priority: HIGHEST for action security_group_rules [ 926.133019] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 with Priority: HIGHEST for action security_group_rules [ 926.133019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.133567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.133740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.134069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.134255] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dbbe6c1-756f-4e7c-8487-e4db654ce155',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.270597] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3214ac00-e98d-4e88-abd4-a1d23683064f tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 with Priority: HIGHEST for action security_group_rules [ 926.270966] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 with Priority: HIGHEST for action security_group_rules [ 926.271466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.271466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.432637] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.433198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.433198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.433198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.433328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.433429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 is going to be created. [ 926.461164] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.461366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.461412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.461603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.461805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.472934] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: UNINITIALIZED for 2s [ 926.656046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.656209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.656388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.656679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.656841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.657014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 already deleted. [ 926.657388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.657388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.657747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.657747] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dbbe6c1-756f-4e7c-8487-e4db654ce155',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.738999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 926.739240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.739952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.740033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.740231] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.740355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.740421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.740583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.740679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.740759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.740887] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.184113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.184277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.184394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.184562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.184684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.184776] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dbbe6c1-756f-4e7c-8487-e4db654ce155 already deleted. [ 927.184867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dbbe6c1-756f-4e7c-8487-e4db654ce155" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.242718] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.242972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.242972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.243194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.244097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.244097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.244097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.244390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.244390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.244466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.244567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.244618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.244813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.244894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.244987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.245101] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.747443] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 927.765821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.765977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.766062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.766288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.766374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.766600] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.766831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.766831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.766946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.767019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.767601] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.768735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.768942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.769150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.769236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.769752] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.769752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.769752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.769752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.769939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.769939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 927.831572] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.831760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.831821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.832099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.832154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.846959] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 928.485078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: SUCCESS [ 928.485305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.485486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.485701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.486610] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.486744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.486812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.487012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.487120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.487235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.487316] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.991025] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.292505] env[65427]: INFO networking_nsxv3.common.synchronization [req-501518bf-d0d6-4d7d-b4de-bfb11ce9f448 req-585a90d3-34a4-4382-9a0b-e8c188f32790 tempest-ServerGroupTestJSON-10039536 tempest-ServerGroupTestJSON-10039536-project-member] Enqueued Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 929.293010] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGHEST for action security_group_members [ 929.294057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.294057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.294057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294573] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.295081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.296260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.296260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.296260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.296260] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.364298] env[65427]: INFO networking_nsxv3.common.synchronization [req-f088be21-983e-4eeb-b797-486eac6a0250 req-8532c910-c058-40eb-a7dc-b93d2b4da6a2 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 929.365125] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 929.369239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.369239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.369239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.369239] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.494181] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9b48d05-4eaa-4bc3-a4df-b76973da2f83: rpc.has_security_group_logging(os_id): False [ 929.515367] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.515698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.515785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.516015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.516157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.516463] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.516571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.516678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.516859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.516966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.517089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 is going to be created. [ 929.580116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.580368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.580368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.580559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.580746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.593570] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: IN_PROGRESS for 2s [ 929.798260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.798484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.798585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.798869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.798973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.799213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.799319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.799388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.799627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.799710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.799863] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad is going to be updated. [ 929.830877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.831072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.831113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.831318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.831463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.845137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: IN_PROGRESS for 2s [ 929.867357] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 929.867694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.871554] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.871554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.871554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.871930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.897698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.898241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.898999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.898999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.898999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.898999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.898999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 929.933188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.933188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.933188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.934015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.934015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.944549] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 930.565627] env[65427]: INFO networking_nsxv3.common.synchronization [req-87326b9e-c993-411e-b0a9-d7aa0df79e81 req-8906f5b1-0539-4214-9178-6c0bdbd14d27 tempest-ServersAdminTestJSON-1029705969 tempest-ServersAdminTestJSON-1029705969-project-member] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 930.565627] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGHEST for action security_group_members [ 930.565973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.566112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.566112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.566277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.566440] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.566545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.566607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.566836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.566933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.567055] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.072913] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.072913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.072913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.072913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.097155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.097431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.097552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.097621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.097824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.097910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.097999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be updated. [ 931.128793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.128969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.129078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.129351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.129540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.140305] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: IN_PROGRESS for 2s [ 931.607641] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: SUCCESS [ 931.607943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.793074] env[65427]: INFO networking_nsxv3.common.synchronization [req-f8d92de6-09b6-45bd-a4ac-6b777e718316 req-5a37555c-6449-4989-9f5d-98d6c05f2724 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 931.793805] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 931.794595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.794595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.794595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.794862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.794862] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.794966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.795061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.795218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.795303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.795397] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.856916] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad in Status: SUCCESS [ 931.856916] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad deletion is rescheduled due to dependency. [ 931.856916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.969857] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 931.971189] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 931.971452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.016834] env[65427]: INFO networking_nsxv3.common.synchronization [req-fe77fe69-704a-46e1-b9d1-93ec44ff4d8a req-8685c54b-4b10-454a-b5b9-bce89afa165b tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 932.017448] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGHEST for action security_group_members [ 932.017772] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.017894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.018071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.018178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.018332] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.018431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.018495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.018675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.018764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.018878] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.152805] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.153592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.153592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.153592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.153935] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.154180] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.154377] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.154759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.154991] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.156519] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.156740] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.156926] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.157567] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.157962] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.157962] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.158252] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.181754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.181934] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.182090] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.182267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.182590] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-4e3046ef-83d0-45e9-b6f5-900ed1e87205 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.182856] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.182984] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.183329] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.183474] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3046ef-83d0-45e9-b6f5-900ed1e87205',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.299047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.299304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.299304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.299599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.299720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.299957] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.300122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.300122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.300298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.300378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.300447] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b already deleted. [ 932.300528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.526153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.526153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.526153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.526153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.546746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.547787] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.547787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.547787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.547787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.547787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.547787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c is going to be updated. [ 932.581225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.581454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.581454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.581640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.581787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.592763] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: IN_PROGRESS for 2s [ 932.686469] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.686827] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.686827] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.687021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.687962] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.687962] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 4e3046ef-83d0-45e9-b6f5-900ed1e87205 not found, creating... [ 932.687962] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.687962] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.688311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.688311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.690474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.690474] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.690474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.690474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.690474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.692637] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.692637] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 4e3046ef-83d0-45e9-b6f5-900ed1e87205 is going to be created. [ 932.713417] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.713644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.713769] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.714762] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.714762] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.714762] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.152487] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 in Status: SUCCESS [ 933.152487] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 deletion is rescheduled due to dependency. [ 933.152487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.470636] env[65427]: INFO networking_nsxv3.common.synchronization [req-f8d92de6-09b6-45bd-a4ac-6b777e718316 req-22d599a8-9078-4790-b9be-52d501c90d0f service nova] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_rules [ 933.470886] env[65427]: INFO networking_nsxv3.common.synchronization [req-f8d92de6-09b6-45bd-a4ac-6b777e718316 req-22d599a8-9078-4790-b9be-52d501c90d0f service nova] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 933.470943] env[65427]: INFO networking_nsxv3.common.synchronization [req-f8d92de6-09b6-45bd-a4ac-6b777e718316 req-22d599a8-9078-4790-b9be-52d501c90d0f service nova] Enqueued Resource ID: 4e3046ef-83d0-45e9-b6f5-900ed1e87205 with Priority: HIGHEST for action port [ 933.471481] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_rules [ 933.471613] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 933.471714] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e3046ef-83d0-45e9-b6f5-900ed1e87205 with Priority: HIGHEST for action port [ 933.471994] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.472311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.472359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.472633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.472724] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.473942] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.474067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.474137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.474311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.474787] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.474903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.474979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.475140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.476748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.476748] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.477261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e3046ef-83d0-45e9-b6f5-900ed1e87205 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.477421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.477477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.477627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.477703] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3046ef-83d0-45e9-b6f5-900ed1e87205',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.979669] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.979669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.980032] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.980695] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e3046ef-83d0-45e9-b6f5-900ed1e87205 with status ACTIVE [ 933.980888] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.981081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.981205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.981515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.981577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.982217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.982217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.982217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.982217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.982217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.982447] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.982447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.982591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.982668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.982764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.982930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e3046ef-83d0-45e9-b6f5-900ed1e87205 is going to be updated. [ 934.009022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.009022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.009022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.009022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.009022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.009291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e3046ef-83d0-45e9-b6f5-900ed1e87205" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.485455] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.609089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c in Status: SUCCESS [ 934.609392] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c deletion is rescheduled due to dependency. [ 934.609749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.988194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.988475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.988475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.988655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.988788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.988833] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be created. [ 935.013838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.013990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.014076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.014337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.014439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.025899] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: UNINITIALIZED for 2s [ 937.036973] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 937.037248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.037395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.037608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.037804] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.037932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.038015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.038197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.038279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.038364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.038463] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.545030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.545030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.545030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.545030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.545030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.545921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.545921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.545921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.545921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.545921] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.047511] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a66c3424-adb0-472b-bb3b-fbb14607817b: rpc.has_security_group_logging(os_id): False [ 938.070817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.070968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.070968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.071207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.071303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.071525] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.071630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.071694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.071853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.071933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.072129] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.072227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.072291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.072426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.072554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.072694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.072785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.072848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.073020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.073278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.073401] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be created. [ 938.147104] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.147104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.147104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.147104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.147104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.165186] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 938.473378] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 938.473582] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 938.643202] env[65427]: INFO networking_nsxv3.common.synchronization [None req-1bd88a44-1a6c-4b91-90af-5c05d599aefb None None] Enqueued Resource ID: fc24b1fd-11d8-4cee-9bc2-c1130e807b03 with Priority: HIGHEST for action port [ 938.643202] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc24b1fd-11d8-4cee-9bc2-c1130e807b03 with Priority: HIGHEST for action port [ 938.643202] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc24b1fd-11d8-4cee-9bc2-c1130e807b03 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.643202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc24b1fd-11d8-4cee-9bc2-c1130e807b03" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.643202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc24b1fd-11d8-4cee-9bc2-c1130e807b03" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.643422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc24b1fd-11d8-4cee-9bc2-c1130e807b03" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.643456] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc24b1fd-11d8-4cee-9bc2-c1130e807b03',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.147390] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc24b1fd-11d8-4cee-9bc2-c1130e807b03 [ 939.147694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.147768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.148390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.148390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.148390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.148390] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc24b1fd-11d8-4cee-9bc2-c1130e807b03 already deleted. [ 939.148390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc24b1fd-11d8-4cee-9bc2-c1130e807b03" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.184906] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 940.185348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.227941] env[65427]: INFO networking_nsxv3.common.synchronization [None req-64c666dd-9897-43ca-a7f0-b0c0f914d8bf None None] Enqueued Resource ID: 5b850747-4046-44ca-8cd1-9242c876029c with Priority: HIGHEST for action port [ 941.228561] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b850747-4046-44ca-8cd1-9242c876029c with Priority: HIGHEST for action port [ 941.228905] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b850747-4046-44ca-8cd1-9242c876029c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.229130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b850747-4046-44ca-8cd1-9242c876029c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.229368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b850747-4046-44ca-8cd1-9242c876029c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.229510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b850747-4046-44ca-8cd1-9242c876029c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.229590] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b850747-4046-44ca-8cd1-9242c876029c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.540288] env[65427]: INFO networking_nsxv3.common.synchronization [req-1c4873ca-f9f9-4d5b-95c0-d05319a3f99e req-bc83d693-0864-4d4f-b8ec-30c971dc27f4 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 941.540493] env[65427]: INFO networking_nsxv3.common.synchronization [req-1c4873ca-f9f9-4d5b-95c0-d05319a3f99e req-bc83d693-0864-4d4f-b8ec-30c971dc27f4 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 941.540625] env[65427]: INFO networking_nsxv3.common.synchronization [req-1c4873ca-f9f9-4d5b-95c0-d05319a3f99e req-bc83d693-0864-4d4f-b8ec-30c971dc27f4 tempest-SecurityGroupsTestJSON-1130313698 tempest-SecurityGroupsTestJSON-1130313698-project-member] Enqueued Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 941.541166] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGHEST for action security_group_members [ 941.541305] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGHEST for action security_group_members [ 941.541403] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGHEST for action security_group_members [ 941.541746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.541882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.541964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.542514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.542571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.542664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.542747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.542919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.543013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.543114] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.543987] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.544058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.544128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.544259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.544401] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.544494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.544586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.544690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.544782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.544892] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.545994] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.545994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.545994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.545994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.546391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.546506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.546572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.546716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.546818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.546871] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.732721] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b850747-4046-44ca-8cd1-9242c876029c [ 941.732721] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.732929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.732929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.734236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.734236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.734236] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b850747-4046-44ca-8cd1-9242c876029c already deleted. [ 941.734236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b850747-4046-44ca-8cd1-9242c876029c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.049516] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.049661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.049730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.050012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.051514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.051514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.051615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.051712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.071827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.071917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.071981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.072054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.072720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.072720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.072720] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be updated. [ 942.073611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.073785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.073894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.074075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.074288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.074288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.074377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.074453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.074825] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be updated. [ 942.075377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.075539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.104218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.104495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.104628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.104697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.104959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.105051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.105146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd is going to be updated. [ 942.107180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.107309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.107371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.107512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.107642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.109151] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.109254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.109328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.109474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.109588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.119387] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: IN_PROGRESS for 2s [ 942.119914] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: IN_PROGRESS for 2s [ 942.138398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.138566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.138656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.138886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.139041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.148193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: IN_PROGRESS for 2s [ 944.132039] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 in Status: SUCCESS [ 944.132334] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 deletion is rescheduled due to dependency. [ 944.132416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.133237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a in Status: SUCCESS [ 944.133324] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a deletion is rescheduled due to dependency. [ 944.133430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.161029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd in Status: SUCCESS [ 944.161651] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd deletion is rescheduled due to dependency. [ 944.161651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.348172] env[65427]: INFO networking_nsxv3.common.synchronization [req-3588a901-7165-428f-a93d-66b617a13603 req-df6a72b1-79d1-4e3a-8b93-b5931218f009 tempest-ServersNegativeTestJSON-726626064 tempest-ServersNegativeTestJSON-726626064-project-member] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 945.348866] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 945.349308] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.349445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.349521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.349726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.350549] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.351930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.351930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.351930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.351930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.351930] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.688512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.688512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.688512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.688512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.688512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.688512] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.688872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.688872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.688982] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.689207] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.689338] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.689445] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.689565] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.689674] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.689804] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.689940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.710715] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.710917] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.711071] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.711295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.711603] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-0da4d64a-065a-4626-b86c-4bbc2a33495e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.711800] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.711933] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.712275] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.712413] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da4d64a-065a-4626-b86c-4bbc2a33495e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.855612] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.214899] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.215246] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.215411] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.215816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.216047] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.216251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 0da4d64a-065a-4626-b86c-4bbc2a33495e not found, creating... [ 946.216563] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.216776] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.216927] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.217266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.217420] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.218115] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.218297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.218425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.218730] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.218810] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.218913] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 0da4d64a-065a-4626-b86c-4bbc2a33495e is going to be created. [ 946.246030] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.247045] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.247045] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.247045] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.247045] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.247400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.348880] env[65427]: INFO networking_nsxv3.common.synchronization [req-edd1209e-6bb8-4139-9d31-1edd44e833ca req-bc293cae-ffc4-4884-9069-108c77d4cf56 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 946.349544] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 946.349874] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.350014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.350092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.350345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.350568] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.350687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.350764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.350970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.351152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.351311] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.357473] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.853793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.854015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.854168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.854373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.854488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.854739] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.854885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.854973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.855180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.855282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.855435] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 946.859814] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.859814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.859814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.860093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.860129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.860227] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 946.891113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.891292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.891342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.891537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.891822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.893677] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.893815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.893864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.894196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.894196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.903407] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 946.907016] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 946.949940] env[65427]: INFO networking_nsxv3.common.synchronization [req-3588a901-7165-428f-a93d-66b617a13603 req-d30f5c19-7d66-4ee3-bcad-c1e3f9127c92 service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 946.950171] env[65427]: INFO networking_nsxv3.common.synchronization [req-3588a901-7165-428f-a93d-66b617a13603 req-d30f5c19-7d66-4ee3-bcad-c1e3f9127c92 service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 946.950316] env[65427]: INFO networking_nsxv3.common.synchronization [req-3588a901-7165-428f-a93d-66b617a13603 req-d30f5c19-7d66-4ee3-bcad-c1e3f9127c92 service nova] Enqueued Resource ID: 0da4d64a-065a-4626-b86c-4bbc2a33495e with Priority: HIGHEST for action port [ 946.950854] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 946.951132] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 946.951439] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da4d64a-065a-4626-b86c-4bbc2a33495e with Priority: HIGHEST for action port [ 946.951971] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.952123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.952235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.952498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.952630] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.953685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.953842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.954190] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0da4d64a-065a-4626-b86c-4bbc2a33495e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.954432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.954554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.954854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.954998] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da4d64a-065a-4626-b86c-4bbc2a33495e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.458212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.458212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.458212] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0da4d64a-065a-4626-b86c-4bbc2a33495e with status ACTIVE [ 947.458212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.458212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.458212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.458649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.458649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.458716] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.458816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.458881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.459074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.459198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.459349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.459472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.459514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.459645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.459725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.459809] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0da4d64a-065a-4626-b86c-4bbc2a33495e is going to be updated. [ 947.483317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.483551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.483551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.483798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.483906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.484098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0da4d64a-065a-4626-b86c-4bbc2a33495e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.919911] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 948.919911] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 948.919911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.919911] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 948.919911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.919911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.919911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.919911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.920411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.920411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.920411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.920411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.920411] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.423193] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.926278] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.101640] env[65427]: INFO networking_nsxv3.common.synchronization [req-6a615a7c-9b1d-4b3b-8075-e0e3d0e6b4c4 req-db10fe7d-ee37-4506-8df2-e9289cbfd8e1 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 950.102234] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 950.102551] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.102677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.102742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.103018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103208] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.103318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.103381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.103540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.103718] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.430610] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.430880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.431016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.431357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.431495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.431610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 950.468955] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.468955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.468955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.468955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.468955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.478025] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 950.606874] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.607055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.607144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.607439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.633505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.633505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.633505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.633505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.633824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.633824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.633894] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 950.664361] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.664361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.664361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.664361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.664361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.673294] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 952.489528] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 952.489898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.489971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.490153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.491194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.491194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.491194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.491194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.491194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.491194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.491194] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.684905] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 952.685217] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 952.685373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.993840] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.993840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.993840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.994803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.994803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.995309] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.995309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.995309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.995309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.995473] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.995473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.995473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.996192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.996192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.996192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.996192] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.498076] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b945fd5-1333-4892-be63-1784a8a66349: rpc.has_security_group_logging(os_id): False [ 953.518501] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.518646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.518719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.518925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.538851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.539238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.539421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.539566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.539827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.539969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.540246] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.540735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.540735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.540735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.540735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.540937] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.541022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.541099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.541339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.541339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.541639] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 953.605854] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.605998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.606077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.606385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.606458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.623432] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 955.102769] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 955.103096] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 955.640035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 955.640301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.103684] env[65427]: INFO networking_nsxv3.common.synchronization [req-e70caaab-6385-4899-ad5a-d90618eeae95 req-4a834260-7ea6-4b9f-9420-8fa9e0af3276 tempest-ServersNegativeTestJSON-726626064 tempest-ServersNegativeTestJSON-726626064-project-member] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 958.104304] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 958.104665] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.104793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.104906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.106063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.106265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.106787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.106787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.106787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.106787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.106787] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.150800] env[65427]: INFO networking_nsxv3.common.synchronization [req-a7259f2d-6e6b-4519-b763-1ae1cdc5f8eb req-15ea1e71-a16f-4526-ac00-09dd382070bc tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 958.150907] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 958.151227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.151373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.151441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.151645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.151812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.151915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.151988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.152142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.152218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.152311] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.609214] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.657053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.657192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.657232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.657647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.657647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.657757] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.657816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.657865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.658020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.658106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.658210] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be updated. [ 958.692400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.692562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.692613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.693009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.693098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.696192] env[65427]: INFO networking_nsxv3.common.synchronization [req-da22fe1b-3392-4401-916f-c70cafc27d54 req-89e35d30-19af-4e34-9729-b941301de747 tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 958.696697] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 958.697304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.697934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.697934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.697934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.697934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.698141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.698141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.698201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.698230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.698352] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.702911] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 959.004822] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.004822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.005014] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.005590] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.005590] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.005773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.005965] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.007013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.007013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.007013] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.007013] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.007013] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.007227] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.007227] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.007448] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.007622] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.027035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.027246] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.027385] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.027564] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.027890] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-bc12d155-fcc3-492c-a8b6-ce364f2a6869 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.028081] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.028206] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.028581] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.028727] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12d155-fcc3-492c-a8b6-ce364f2a6869',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.111490] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.201802] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.201802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.201802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.201802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.201802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.202055] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.202055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.202055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.202158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.202236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.202913] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 already deleted. [ 959.202913] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.531661] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.531824] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.531824] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.532123] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.532280] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.532430] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port bc12d155-fcc3-492c-a8b6-ce364f2a6869 not found, creating... [ 959.532690] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.532842] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.532957] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.533264] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.533344] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.533626] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.533781] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.533896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.534113] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.534244] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.534381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 is going to be created. [ 959.556557] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.556757] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.556918] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.557238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.557474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.557703] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.614647] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.614833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.615250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.615250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.615383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.615383] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 959.657803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.658054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.658152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.658393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.658566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.667751] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 960.272651] env[65427]: INFO networking_nsxv3.common.synchronization [req-da22fe1b-3392-4401-916f-c70cafc27d54 req-8e98e34f-0c37-4a2b-9ffa-9c41c0f5a85c service nova] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 960.272651] env[65427]: INFO networking_nsxv3.common.synchronization [req-da22fe1b-3392-4401-916f-c70cafc27d54 req-8e98e34f-0c37-4a2b-9ffa-9c41c0f5a85c service nova] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 960.273037] env[65427]: INFO networking_nsxv3.common.synchronization [req-da22fe1b-3392-4401-916f-c70cafc27d54 req-8e98e34f-0c37-4a2b-9ffa-9c41c0f5a85c service nova] Enqueued Resource ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 with Priority: HIGHEST for action port [ 960.273355] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 960.273492] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 960.273592] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 with Priority: HIGHEST for action port [ 960.273877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.273999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.274113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.274283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.274374] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.275756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.276028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.276108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.276293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.276450] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.276550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.276613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.276754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.276837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.276928] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.277789] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc12d155-fcc3-492c-a8b6-ce364f2a6869 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.277865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.277918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.278089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.278162] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12d155-fcc3-492c-a8b6-ce364f2a6869',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.713781] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 960.713904] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b deletion is rescheduled due to dependency. [ 960.714038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.780303] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.780449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.780627] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.781574] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc12d155-fcc3-492c-a8b6-ce364f2a6869 with status ACTIVE [ 960.781789] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.781906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.781975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.782211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.782311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.782886] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.782886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.782886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.782886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.782886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.783224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.783224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.783224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.783384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.783384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.783489] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 is going to be updated. [ 960.803673] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.803829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.803870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.804093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.804228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.804385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.179549] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-3a637435-9624-473e-8040-9de50dd47ca3 tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 961.180126] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 961.180465] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.180597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.180646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.180915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.181082] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.181263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.181263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.181444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.181547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.181622] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.285230] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.616639] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.616639] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.616639] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.616639] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.616639] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.616639] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.616639] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.618879] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.618879] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.618879] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.618879] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.618879] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.618879] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.618879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.618879] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-6089b925-cd46-4565-8eec-0b713f808a86 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.618879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.618879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.618879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.618879] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089b925-cd46-4565-8eec-0b713f808a86',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.679161] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 961.679449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.684241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.684241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.684241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.684678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.684678] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d already deleted. [ 961.684678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.787877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.788106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.788194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.788415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.789052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.789052] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be created. [ 961.812992] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.812992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.813191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.813301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.813461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.824063] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: UNINITIALIZED for 2s [ 962.096424] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.096699] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.096791] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.097082] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.097238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.097401] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 6089b925-cd46-4565-8eec-0b713f808a86 not found, creating... [ 962.097676] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.097830] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.097959] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.098292] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.098376] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.098683] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.098837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.098960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.099194] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.099336] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.099474] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 6089b925-cd46-4565-8eec-0b713f808a86 is going to be created. [ 962.120456] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.120672] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.120763] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.121145] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.121476] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.121761] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.814353] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-b9534eb3-f416-40f1-bf81-143ca9cf6785 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 962.814353] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-b9534eb3-f416-40f1-bf81-143ca9cf6785 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 962.814691] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-b9534eb3-f416-40f1-bf81-143ca9cf6785 service nova] Enqueued Resource ID: 6089b925-cd46-4565-8eec-0b713f808a86 with Priority: HIGHEST for action port [ 962.816128] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 962.816128] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 962.816128] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6089b925-cd46-4565-8eec-0b713f808a86 with Priority: HIGHEST for action port [ 962.816128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.816128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.816128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.818128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.818128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.818128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.818128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.818128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.819017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6089b925-cd46-4565-8eec-0b713f808a86 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.819017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.819017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.819460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.819460] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089b925-cd46-4565-8eec-0b713f808a86',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.321840] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.322010] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.323694] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6089b925-cd46-4565-8eec-0b713f808a86 with status ACTIVE [ 963.323694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.323694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.323694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.323694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.324268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.324268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.324268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6089b925-cd46-4565-8eec-0b713f808a86 is going to be updated. [ 963.325050] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.346134] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.346317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.346364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.346548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.346682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.346841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6089b925-cd46-4565-8eec-0b713f808a86" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.759370] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-1d01100b-02f2-4bb0-83ef-3e434bb0740c tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 963.760427] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 963.760427] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.760427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.826880] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.837038] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: SUCCESS [ 963.837287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.838525] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.838525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.838525] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.092127] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.092355] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.092483] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.092919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.094233] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.094233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.094233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.094233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.094233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.094233] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.094583] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.095672] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.095672] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.095672] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.095672] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.095672] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.114478] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.115702] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.116140] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.117210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.117690] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-0c5f4e19-1404-425f-b915-7a8326cf4863 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.117985] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.118194] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.118544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.118721] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c5f4e19-1404-425f-b915-7a8326cf4863',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.329504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.329670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.329742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.329960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.330079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.330198] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be created. [ 964.342275] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.353161] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.353311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.353374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.353594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.353755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.363519] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: UNINITIALIZED for 2s [ 964.622653] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.623721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.623721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.623879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.623942] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.624166] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 0c5f4e19-1404-425f-b915-7a8326cf4863 not found, creating... [ 964.624524] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.624739] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.624857] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.625215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.625372] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.625694] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.625894] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.625988] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.626255] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.626463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.626549] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 0c5f4e19-1404-425f-b915-7a8326cf4863 is going to be created. [ 964.649298] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.649628] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.649842] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.650118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.650455] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.650677] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.848806] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c3613c9-fe90-4521-87ed-64503d04b3d5: rpc.has_security_group_logging(os_id): False [ 964.866856] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.867131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.867251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.868433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.868595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.868949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.869105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.869174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.869367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.869451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.869546] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be created. [ 964.937923] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.938073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.938159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.938428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.938649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.954044] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: IN_PROGRESS for 2s [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-4057d58f-836c-407b-b3ca-0f05b2228911 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-4057d58f-836c-407b-b3ca-0f05b2228911 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [req-e59b5b17-14a2-44da-a86b-62fb69de7991 req-4057d58f-836c-407b-b3ca-0f05b2228911 service nova] Enqueued Resource ID: 0c5f4e19-1404-425f-b915-7a8326cf4863 with Priority: HIGHEST for action port [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 965.371463] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5f4e19-1404-425f-b915-7a8326cf4863 with Priority: HIGHEST for action port [ 965.376159] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.376159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.376159] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.376159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.376159] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c5f4e19-1404-425f-b915-7a8326cf4863 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.376374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.376374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.378488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.378488] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c5f4e19-1404-425f-b915-7a8326cf4863',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.881681] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c5f4e19-1404-425f-b915-7a8326cf4863 with status ACTIVE [ 965.882118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.882356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.882460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.882816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.882992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.883277] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.883395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.883480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.883703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.883838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.884172] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.884290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.884388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.884523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.884647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.884813] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c5f4e19-1404-425f-b915-7a8326cf4863 is going to be updated. [ 965.907091] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.907258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.907554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.907792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.907933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.908116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c5f4e19-1404-425f-b915-7a8326cf4863" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.378136] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.378136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.378136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.378136] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.379900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.381473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.381473] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.381473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.381473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.381858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.381858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.381858] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.401042] env[65427]: INFO networking_nsxv3.common.synchronization [req-e8621589-7f2c-42f6-826a-d2070f1d4e86 req-3969d3d9-9702-4c5b-b255-48c6df953652 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 966.403263] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 966.403921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.404093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.404201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.404505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.404697] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.404849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.405017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.405262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.405410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.405575] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.807731] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.807941] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.808084] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.808374] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.808643] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.808805] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.811614] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.812468] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.812701] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.813048] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.813271] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.813425] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.813543] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.813663] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.813958] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.813958] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.834370] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.834551] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.834691] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.834872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.836419] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.836833] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.836833] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.837680] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.837892] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.883748] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.884266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.884266] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.908276] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.908466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.908520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.908715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.908804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.909022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.909127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.909166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.909317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.909392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.909476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 966.937046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.937288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.937362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.937522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.937671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.955018] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 966.965589] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: SUCCESS [ 966.965829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.344184] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.344525] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.344765] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.345225] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.345487] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.345749] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 not found, creating... [ 967.346223] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.346498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.346713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.347095] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.347345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.347814] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.348092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.348307] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.348643] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.348902] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.349490] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 is going to be created. [ 967.372517] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.372799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.372927] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.373346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.373627] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.373877] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.385808] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.887990] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.888419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.888419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.888502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.888590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.888690] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 967.919138] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.919138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.919138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.919138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.919138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.929043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [req-e8621589-7f2c-42f6-826a-d2070f1d4e86 req-ab254148-2869-4a03-8613-eec1756c1d03 service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [req-e8621589-7f2c-42f6-826a-d2070f1d4e86 req-ab254148-2869-4a03-8613-eec1756c1d03 service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [req-e8621589-7f2c-42f6-826a-d2070f1d4e86 req-ab254148-2869-4a03-8613-eec1756c1d03 service nova] Enqueued Resource ID: 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 with Priority: HIGHEST for action port [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 968.092265] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 with Priority: HIGHEST for action port [ 968.092265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.092265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.092265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.094183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.094306] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.095399] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.095694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.095694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.095830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.095884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.096049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.096128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.599544] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.600201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.600201] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 with status ACTIVE [ 968.600201] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.600201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.600399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.600487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.601929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.602585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.602943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.605106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.605333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.605438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.605640] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.605741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.605804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.605980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.606259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.606380] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592 is going to be updated. [ 968.632319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.632319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.632319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.632319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.632319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.632319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93ee3b5a-9f3e-4f9c-8e87-aa6604dd0592" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.968091] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 968.968368] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 968.968421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.968585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.968800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.968995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.969129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.969195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.969346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.969425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.969521] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.471920] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.940581] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 969.940980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.941170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.941408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.941606] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.941721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.941787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.941942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.942053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.942157] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.974326] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.444996] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.478172] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.478339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.478387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.478637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.478740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.478843] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 970.497285] env[65427]: INFO networking_nsxv3.common.synchronization [req-bde8e94d-8af2-462f-90bc-cc810a49c330 req-9149de01-e8aa-462f-b781-1dd79e6bb2ed tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 970.498375] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 970.499149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.502118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.502118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.502118] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.511581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.511581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.511581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.511888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.511973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.528078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 970.947839] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.995148] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.995148] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.995602] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.995730] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.996082] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.996262] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.996503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.996891] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.997148] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.998085] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.998085] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.998085] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.998085] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.998085] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.998085] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.998378] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.003537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.003656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.003756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.003916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.004019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.004209] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.004314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.004372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.004523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.004602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.004680] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf already deleted. [ 971.004763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.020135] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.020739] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.021055] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.021383] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.021884] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-ac699666-465c-42d3-9de8-8d57475a3893 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.022220] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.022432] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.022934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.023111] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac699666-465c-42d3-9de8-8d57475a3893',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.450931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.451107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.451188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.451404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.451548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.451619] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 971.486655] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.486818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.486968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.487198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.487346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.496358] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 971.526013] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.526207] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.526341] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.526635] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.526788] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.526945] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port ac699666-465c-42d3-9de8-8d57475a3893 not found, creating... [ 971.527328] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.527518] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.527624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.527853] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.527993] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.528310] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.528467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.528860] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.528860] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.528971] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.529064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: ac699666-465c-42d3-9de8-8d57475a3893 is going to be created. [ 971.549852] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.550104] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.550210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.550493] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.550734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.550966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.339129] env[65427]: INFO networking_nsxv3.common.synchronization [req-bde8e94d-8af2-462f-90bc-cc810a49c330 req-52901176-626c-4fc3-b3eb-6058eefb1d38 service nova] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_rules [ 972.339598] env[65427]: INFO networking_nsxv3.common.synchronization [req-bde8e94d-8af2-462f-90bc-cc810a49c330 req-52901176-626c-4fc3-b3eb-6058eefb1d38 service nova] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 972.339598] env[65427]: INFO networking_nsxv3.common.synchronization [req-bde8e94d-8af2-462f-90bc-cc810a49c330 req-52901176-626c-4fc3-b3eb-6058eefb1d38 service nova] Enqueued Resource ID: ac699666-465c-42d3-9de8-8d57475a3893 with Priority: HIGHEST for action port [ 972.342268] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_rules [ 972.342417] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 972.342516] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac699666-465c-42d3-9de8-8d57475a3893 with Priority: HIGHEST for action port [ 972.342826] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.343026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.343124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.343369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.343447] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.344537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.344685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.344750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.344889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.349517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.349684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.349852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.350190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.350691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.350691] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.351716] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac699666-465c-42d3-9de8-8d57475a3893 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.353779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.353779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.353779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.353779] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac699666-465c-42d3-9de8-8d57475a3893',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.540915] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 972.540915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.540915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.540915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.540915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.541148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.541148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.541285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.541425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.541554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.541675] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.765933] env[65427]: INFO networking_nsxv3.common.synchronization [req-b7693964-d2ba-4b10-86de-a929909df45e req-50c0c7ac-8fe2-4c9b-ae14-37e80e7dc764 tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 972.766598] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 972.767766] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.767987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.856522] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.856651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.856803] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.857746] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac699666-465c-42d3-9de8-8d57475a3893 with status ACTIVE [ 972.857939] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.858097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.858179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.858390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.858479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.858659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.858756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.858820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.859016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.860940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.860940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.860940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.860940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.860940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.860940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.860940] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac699666-465c-42d3-9de8-8d57475a3893 is going to be updated. [ 972.887716] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.887867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.887906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.888118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.888263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.888444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac699666-465c-42d3-9de8-8d57475a3893" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.044240] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.044470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.044470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.044665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.045513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.045513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.045513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.045513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.045749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.045749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.045931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.045931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.046045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.046142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.050074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.050074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.050074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.050074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.050074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.050074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.050074] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.213737] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.213966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.214073] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.214335] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.214597] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.214773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.214905] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.215132] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.215283] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.215528] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.215605] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.215703] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.215820] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.215914] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.216037] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.216213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.240456] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.241352] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.241549] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.241744] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.242142] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.242357] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.242442] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.242753] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.242965] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd92a94-1d39-47ef-b33b-e42f017a1a1b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.364333] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.507698] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 973.508555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.508555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.509443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.509443] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.509443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.509443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.509443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.509443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.509694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.509739] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.511222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.512336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.512336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.512336] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.512336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.512336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.512877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.512877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.512877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.512877] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.712866] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7abbe624-4b85-4277-bdd0-ed749e166fc9: rpc.has_security_group_logging(os_id): False [ 973.733533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.733732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.733732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.734217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.734217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.734403] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.734403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.734512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.734625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.734704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.734903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.735115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.735170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.735317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.735436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.735575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.735684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.735746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.735884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.735957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.736094] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 973.746297] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.746297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.746297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.746586] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.746644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.746795] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 2bd92a94-1d39-47ef-b33b-e42f017a1a1b not found, creating... [ 973.747189] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.747345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.747445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.747693] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.747842] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.748252] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.748458] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.748585] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.748772] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.748896] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.749045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 2bd92a94-1d39-47ef-b33b-e42f017a1a1b is going to be created. [ 973.773164] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.773535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.773535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.773839] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.774101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.774416] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.841572] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.841855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.841950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.842310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.842817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.867075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.867075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.867075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.867075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.867075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.867075] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be created. [ 973.874139] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 973.909099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.909369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.909369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.909547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.909703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.926937] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: UNINITIALIZED for 2s [ 974.015177] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd70ac25-12dc-445f-bc13-c1a6930fbf5d: rpc.has_security_group_logging(os_id): False [ 974.037546] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.037777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.037777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.038115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.038220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.038472] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.038575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.038637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.038785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.038897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.039073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.039161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.039199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.039358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.039442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.039909] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.039909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.039909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.040170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.040306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.040440] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be created. [ 974.114870] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.115121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.115244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.115572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.115862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.135763] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 974.490144] env[65427]: INFO networking_nsxv3.common.synchronization [req-b7693964-d2ba-4b10-86de-a929909df45e req-09109b28-323a-4547-b56f-9210bd10b7fb service nova] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_rules [ 974.491698] env[65427]: INFO networking_nsxv3.common.synchronization [req-b7693964-d2ba-4b10-86de-a929909df45e req-09109b28-323a-4547-b56f-9210bd10b7fb service nova] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 974.491698] env[65427]: INFO networking_nsxv3.common.synchronization [req-b7693964-d2ba-4b10-86de-a929909df45e req-09109b28-323a-4547-b56f-9210bd10b7fb service nova] Enqueued Resource ID: 2bd92a94-1d39-47ef-b33b-e42f017a1a1b with Priority: HIGHEST for action port [ 974.491698] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_rules [ 974.491698] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 974.491698] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd92a94-1d39-47ef-b33b-e42f017a1a1b with Priority: HIGHEST for action port [ 974.492012] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.492108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.492315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.492559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.492649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.492741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.492741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.492925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.493550] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd92a94-1d39-47ef-b33b-e42f017a1a1b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.996245] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bd92a94-1d39-47ef-b33b-e42f017a1a1b with status ACTIVE [ 974.996481] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.996617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.996686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.996924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.996989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.997215] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.997389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.997456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.997604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.997683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.997948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.998066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.998115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.998251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.998325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.998410] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bd92a94-1d39-47ef-b33b-e42f017a1a1b is going to be updated. [ 975.020593] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.020593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.020593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.020593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.020593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.020593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd92a94-1d39-47ef-b33b-e42f017a1a1b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.344167] env[65427]: INFO networking_nsxv3.common.synchronization [req-3606eec5-7fc8-4e8d-b444-1139435729c1 req-0393317c-6232-429c-85bd-580772b13373 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 975.344167] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 975.344167] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.344167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.344167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.344677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.345029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.345271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.345614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.345898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.346118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.346311] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.369019] env[65427]: INFO networking_nsxv3.common.synchronization [None req-04dee6b6-0570-4c19-b9e7-ee1cab822873 None None] Enqueued Resource ID: 5b971287-8456-4aa7-bb5c-f54cfead43cf with Priority: HIGHEST for action port [ 975.369019] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b971287-8456-4aa7-bb5c-f54cfead43cf with Priority: HIGHEST for action port [ 975.369523] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b971287-8456-4aa7-bb5c-f54cfead43cf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.369787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b971287-8456-4aa7-bb5c-f54cfead43cf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.369947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b971287-8456-4aa7-bb5c-f54cfead43cf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.370318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b971287-8456-4aa7-bb5c-f54cfead43cf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.370516] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b971287-8456-4aa7-bb5c-f54cfead43cf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.775080] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.775080] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.776718] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.776907] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.777046] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.777458] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.777641] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.777953] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.778022] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.778225] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.778225] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.778328] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.778436] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.778573] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.803183] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.805295] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.805295] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.805295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.805295] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-78dadccb-d993-4631-a69b-615aa5c563af taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.805295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.805295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.805295] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.805295] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78dadccb-d993-4631-a69b-615aa5c563af',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.850303] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.873033] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b971287-8456-4aa7-bb5c-f54cfead43cf [ 975.873316] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.873405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.873475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.873713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.874012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.874012] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b971287-8456-4aa7-bb5c-f54cfead43cf already deleted. [ 975.874012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b971287-8456-4aa7-bb5c-f54cfead43cf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.890317] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 975.892235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.939500] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 975.939815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.939979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.941035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.941035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.941035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.941035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.941035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.941035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.941035] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.154148] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 976.154148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.154148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.154148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.154148] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.308036] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.308036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.308036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.308364] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.308581] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.308767] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 78dadccb-d993-4631-a69b-615aa5c563af not found, creating... [ 976.309090] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.309307] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.309450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.309687] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.309823] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.310204] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.310815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.310815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.310815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.310815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.310987] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 78dadccb-d993-4631-a69b-615aa5c563af is going to be created. [ 976.343693] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.343940] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.344090] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.344394] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.344640] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.344859] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.354282] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.443109] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.656743] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.656986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.656986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.657243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.657433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.657535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.657596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.657744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.657908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.657908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.658031] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.856679] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.856679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.857202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.857202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.857202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.857202] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 976.887799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.887950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.888064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.888243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.888392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.897495] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 976.947321] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.052354] env[65427]: INFO networking_nsxv3.common.synchronization [req-3606eec5-7fc8-4e8d-b444-1139435729c1 req-d33d32c2-0738-468b-81be-d52158669fc9 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 977.052537] env[65427]: INFO networking_nsxv3.common.synchronization [req-3606eec5-7fc8-4e8d-b444-1139435729c1 req-d33d32c2-0738-468b-81be-d52158669fc9 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 977.052671] env[65427]: INFO networking_nsxv3.common.synchronization [req-3606eec5-7fc8-4e8d-b444-1139435729c1 req-d33d32c2-0738-468b-81be-d52158669fc9 service nova] Enqueued Resource ID: 78dadccb-d993-4631-a69b-615aa5c563af with Priority: HIGHEST for action port [ 977.053266] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 977.053431] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 977.053552] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78dadccb-d993-4631-a69b-615aa5c563af with Priority: HIGHEST for action port [ 977.053805] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.053925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.053982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.055518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.055613] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.056480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.056570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.057540] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-78dadccb-d993-4631-a69b-615aa5c563af taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.057540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.057540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.057540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.057540] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78dadccb-d993-4631-a69b-615aa5c563af',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.161829] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.162075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.162178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.162373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.162571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.162774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.162774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.162907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.162981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.163081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.163659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.163659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.163659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.163659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.163831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.163831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.163831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.163981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.164054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.164133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.164249] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.451582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.451582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.451582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.451815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.451863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.453091] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 977.494847] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.495679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.496977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.496977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.496977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.509610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 977.558831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.558973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.560781] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78dadccb-d993-4631-a69b-615aa5c563af with status ACTIVE [ 977.561122] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.561247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.561247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.561433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.561680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.561911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.562046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.562183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.562305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.562425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.562726] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.563023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.563023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.563145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.563276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.563439] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78dadccb-d993-4631-a69b-615aa5c563af is going to be updated. [ 977.587618] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.587776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.587818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.588075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.588355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.588686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78dadccb-d993-4631-a69b-615aa5c563af" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.667389] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd70ac25-12dc-445f-bc13-c1a6930fbf5d: rpc.has_security_group_logging(os_id): False [ 977.689511] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.689712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.689788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.690055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.690169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.690774] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.690774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.690774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.690774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.690971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.690971] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.691080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.692032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.692032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.692032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 977.744056] env[65427]: INFO networking_nsxv3.common.synchronization [None req-38d76f55-1921-41af-b0aa-ec236157e53f None None] Enqueued Resource ID: ee9b6737-a3a3-415e-b072-a92293aa57bc with Priority: HIGHEST for action port [ 977.744882] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9b6737-a3a3-415e-b072-a92293aa57bc with Priority: HIGHEST for action port [ 977.745182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9b6737-a3a3-415e-b072-a92293aa57bc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.745334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9b6737-a3a3-415e-b072-a92293aa57bc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.745764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9b6737-a3a3-415e-b072-a92293aa57bc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.745764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9b6737-a3a3-415e-b072-a92293aa57bc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.747537] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9b6737-a3a3-415e-b072-a92293aa57bc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.783899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.783899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.783899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.783899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.783899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.806335] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 978.249048] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee9b6737-a3a3-415e-b072-a92293aa57bc [ 978.249383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.249383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.249501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.249687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.249770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.249872] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee9b6737-a3a3-415e-b072-a92293aa57bc already deleted. [ 978.249955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9b6737-a3a3-415e-b072-a92293aa57bc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.342737] env[65427]: INFO networking_nsxv3.common.synchronization [req-e45b8085-95f5-4e7b-8877-753715f74b1f req-ff8b5b45-7cc1-4650-bbfa-dcc5d9c7dcaf tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 978.343762] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 978.344121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.344249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.344318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.344580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.344758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.344831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.344889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.345071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.345183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.345238] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.690169] env[65427]: INFO networking_nsxv3.common.synchronization [req-fe102143-73da-4122-bd54-09d9e25224df req-c8cd5a0b-bd18-4ba1-8e3c-a1c2b945f946 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 978.691524] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 978.692777] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.693130] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.693315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.695183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.695613] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.695862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.696068] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.696377] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.696657] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.696931] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.697123] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.697290] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.697470] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.697693] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.697865] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.698071] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.699579] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.699819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.699964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.700217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.700449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.700621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.700717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.701135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.701408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.701612] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.725947] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.726325] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.726564] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.726817] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.727294] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-b4d85f84-f16f-4a8e-838b-42f479bdf555 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.727666] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.727865] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.728400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.728683] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d85f84-f16f-4a8e-838b-42f479bdf555',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.847088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.847469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.847596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.847936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.848139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.848505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.848660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.848749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.848936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.849053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.849183] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a already deleted. [ 978.849295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.908219] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 978.908515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.908758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.909044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.909429] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.909644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.909711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.909959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.910199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.910391] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.166021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.166021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.166021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.166021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.166021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.166021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.166021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.166422] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.166422] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.166590] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.166808] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.167040] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.167209] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.167382] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.167586] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.167730] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.190451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.190649] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.190816] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.191062] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-860" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.191444] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-0764240a-5933-4c6e-9437-6e450b7fa54e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.191728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.191887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.192280] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.192439] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0764240a-5933-4c6e-9437-6e450b7fa54e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.205158] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.205394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.205460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.205740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.205844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.206209] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.206372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.206449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.206936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.207092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.207204] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 979.231580] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.232038] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.232038] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.232430] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.232624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.232856] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port b4d85f84-f16f-4a8e-838b-42f479bdf555 not found, creating... [ 979.233301] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.233513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.233655] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.234129] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.234355] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.234760] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.235027] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.235147] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.235427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.235614] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.235820] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: b4d85f84-f16f-4a8e-838b-42f479bdf555 is going to be created. [ 979.239176] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.239337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.239415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.239651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.239817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.250927] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 979.265074] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.265297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.265434] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.265707] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.266089] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.266383] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.415955] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.522731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 979.523052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.523300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.523585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.523853] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.524015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.524119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.524332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.524442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524733] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.525902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.526123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.527019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.527019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.527019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.527019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.527019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.527019] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.695744] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.695996] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.696186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.696503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.696660] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.696821] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 0764240a-5933-4c6e-9437-6e450b7fa54e not found, creating... [ 979.697104] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.697448] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.697677] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.697956] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.698118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.698459] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.698692] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.698773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.698988] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.699172] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.699304] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 0764240a-5933-4c6e-9437-6e450b7fa54e is going to be created. [ 979.718208] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.719043] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.719043] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.719043] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.719043] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.719251] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.819481] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 979.819481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.919047] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.977945] env[65427]: INFO networking_nsxv3.common.synchronization [req-e45b8085-95f5-4e7b-8877-753715f74b1f req-5851fc3e-f94c-4fed-8fb6-7058afd1526e service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 979.978154] env[65427]: INFO networking_nsxv3.common.synchronization [req-e45b8085-95f5-4e7b-8877-753715f74b1f req-5851fc3e-f94c-4fed-8fb6-7058afd1526e service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 979.978444] env[65427]: INFO networking_nsxv3.common.synchronization [req-e45b8085-95f5-4e7b-8877-753715f74b1f req-5851fc3e-f94c-4fed-8fb6-7058afd1526e service nova] Enqueued Resource ID: b4d85f84-f16f-4a8e-838b-42f479bdf555 with Priority: HIGHEST for action port [ 979.978902] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 979.979082] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 979.979362] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d85f84-f16f-4a8e-838b-42f479bdf555 with Priority: HIGHEST for action port [ 979.979524] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.979648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.979714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.979961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.980057] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.981289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.981472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.981638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.981785] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.981944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.982205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.982205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.982291] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.984816] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d85f84-f16f-4a8e-838b-42f479bdf555 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.984816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.984816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.984816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.984816] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d85f84-f16f-4a8e-838b-42f479bdf555',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.028471] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.028606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.028805] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.376895] env[65427]: INFO networking_nsxv3.common.synchronization [req-d49f70c4-8e38-4904-87d6-0ca84cc6c2cd req-9c8a52df-2b04-483e-918d-33df5c3b313b tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 980.377494] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGHEST for action security_group_members [ 980.377832] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.377953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.378802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.379151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.379342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.379456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.379520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.379791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.379895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.379993] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.421089] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.421307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.421414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.421657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.421771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.421903] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 980.454561] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.454788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.454837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.455094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.455246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.463668] env[65427]: INFO networking_nsxv3.common.synchronization [req-fe102143-73da-4122-bd54-09d9e25224df req-88081f22-2c57-4464-a50a-fe56b7ff7133 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 980.463847] env[65427]: INFO networking_nsxv3.common.synchronization [req-fe102143-73da-4122-bd54-09d9e25224df req-88081f22-2c57-4464-a50a-fe56b7ff7133 service nova] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 980.463982] env[65427]: INFO networking_nsxv3.common.synchronization [req-fe102143-73da-4122-bd54-09d9e25224df req-88081f22-2c57-4464-a50a-fe56b7ff7133 service nova] Enqueued Resource ID: 0764240a-5933-4c6e-9437-6e450b7fa54e with Priority: HIGHEST for action port [ 980.464494] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_rules [ 980.464630] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 980.465029] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0764240a-5933-4c6e-9437-6e450b7fa54e with Priority: HIGHEST for action port [ 980.465959] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 980.466284] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.466437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.466523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.466740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.466849] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.468095] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.468294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.468501] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0764240a-5933-4c6e-9437-6e450b7fa54e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.468634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.468703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.468884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.468963] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0764240a-5933-4c6e-9437-6e450b7fa54e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.484842] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.485153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.485497] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.486794] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d85f84-f16f-4a8e-838b-42f479bdf555 with status ACTIVE [ 980.486876] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.487220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.487220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.487506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.487579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.487945] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.488114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.488214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.488389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.488480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.488676] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.488773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.488865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.488975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.489060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.489150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d85f84-f16f-4a8e-838b-42f479bdf555 is going to be updated. [ 980.519136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.519136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.519136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.519136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.519136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.519575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d85f84-f16f-4a8e-838b-42f479bdf555" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.531383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.850093] env[65427]: INFO networking_nsxv3.common.synchronization [req-b478967b-cf7a-4844-9a9a-faa8966b50ba req-9a112d0f-12c5-49c7-9a8f-d79a8b138808 tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 980.850397] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 980.850710] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.850833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.850901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.851125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.851299] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.851407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.851470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.851620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.851705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.851797] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.882941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.883409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.883521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.883711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.905537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.905799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.905935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.906014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.906247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.906332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.906428] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f is going to be updated. [ 980.933600] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.933766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.933815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.934082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.934231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.945056] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: IN_PROGRESS for 2s [ 980.970685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.970843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.974279] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0764240a-5933-4c6e-9437-6e450b7fa54e with status ACTIVE [ 980.974562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.974701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.974771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.974998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.975120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.975322] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.975419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.975457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.975654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.975711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.975896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.976044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.976193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.976246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.976324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.976413] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0764240a-5933-4c6e-9437-6e450b7fa54e is going to be updated. [ 980.993290] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.000938] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.001104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.001163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.001390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.001539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.001697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0764240a-5933-4c6e-9437-6e450b7fa54e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.033789] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.033961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.034172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.034471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.034572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.034775] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 981.040375] env[65427]: INFO networking_nsxv3.common.synchronization [req-686dfe91-a9c4-493b-bbb6-093873ac72af req-efcfc663-5704-4bfd-9168-5fe583d620df tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 981.041365] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 981.041963] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.041963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.067402] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.067623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.067727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.067942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.068187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.081117] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 981.261319] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 981.261499] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 981.261547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.261702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.261923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262129] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.262247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.262312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.262465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.262652] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.354454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.354454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.354454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.354797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.354797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.355353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.355353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.355353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.355353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.355353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.355633] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 981.386708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.387081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.387081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.387151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.387268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.397639] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 981.496064] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.496064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.496064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.496064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.496064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.496064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be created. [ 981.524144] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.524144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.524144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.524144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.524144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.535846] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: UNINITIALIZED for 2s [ 981.764841] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.269290] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.478930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 982.478930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.478930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.478930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.478930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.479675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.479820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.480120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.480243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.480378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.480550] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.772405] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.772631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.772718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.772860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.772952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.773086] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 982.803744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.803965] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.804024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.805036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.805036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.815847] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 982.957252] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f in Status: SUCCESS [ 982.957453] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f deletion is rescheduled due to dependency. [ 982.957663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.984685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.984969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.984969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.985178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.985333] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.985460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.985537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.985699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.985788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.985878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.986049] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.986153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.986244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.986469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.986668] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.986798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.986958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.987242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.987242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.987242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.987393] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.091873] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 983.092238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.092380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.092604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.092804] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.092980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.093097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.093424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.093424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.093559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.093723] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.093846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.093920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.094100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.094373] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.094450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.094505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.094611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.094681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.094769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.094864] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.413368] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 983.413368] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d deletion is rescheduled due to dependency. [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.413368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.413368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.413368] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.491670] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 983.511184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.512272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.512272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.512272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.533087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.533399] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.533531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.533590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.533804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.533889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.534448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.534448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.534448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.534659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.534659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.534824] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.535191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.535325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.535519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.535695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.535816] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 983.554483] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 983.554823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.555069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.555447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.555847] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.556093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.556093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.556315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.556404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.556498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.556618] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.596999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07e38e11-5e71-4d2b-b175-0954d843dabf: rpc.has_security_group_logging(os_id): False [ 983.617053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.617236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.617284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.618140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.618140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.619576] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.619685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.620730] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.620730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.621048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.621048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.621048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.621156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.621187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.621353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.621436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.621492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.621626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.621693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.621776] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be created. [ 983.644792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 983.724232] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.724232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.724232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.724792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.724792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.745858] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 983.918217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.918412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.918412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.918690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.918778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.919009] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.919155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.919253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.919330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.919427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.919478] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 983.949667] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.949667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.950670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.950927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.951090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.968300] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 984.059083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.059413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.059413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.059852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.059852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.059852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.060087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.060087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.060248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.060248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.060345] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.060417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.060479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.060622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.060764] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.061032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.061032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.061165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.061165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.061307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.061307] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.565545] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a: rpc.has_security_group_logging(os_id): False [ 984.585312] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.585398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.585479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.585761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.585802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.586055] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.586165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.586227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.586398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.586478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.586670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.586764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.586824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.586963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.587051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.587238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.587334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.587404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.587541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.587615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.587701] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be created. [ 984.650270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.650413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.650485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.650697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.650876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.662929] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 984.828253] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 984.828754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.828754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.829581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.829581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.829581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.829581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.829847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.829924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.830417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.830417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.334014] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.334355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.334502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.334712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.334891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.334994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.335103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.335256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.335345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.335436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.335694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.335795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.335855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.336068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.336152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.336304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.336304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.336449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.336502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.336575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.336672] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.663481] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 985.664385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.759327] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 985.759904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.760209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.760369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.760459] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.838812] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54fe1b7a-483b-4522-ab83-ced21005a9ad: rpc.has_security_group_logging(os_id): False [ 985.859161] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.859378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.859378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.859603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.859679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.859819] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.860107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.860107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.860231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.860231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.860767] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.860767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.860767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.860767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.861135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.861135] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.861244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.861244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.861624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.861624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.861624] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 985.929584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.929685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.929842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.930041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.930108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.946881] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 985.981246] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 985.981381] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d deletion is rescheduled due to dependency. [ 985.981381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.042487] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 986.042744] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 986.263319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.263393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.263806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.263806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.263949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.264123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.264275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.264380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.264504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.264565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.264664] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.464127] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0281d991-e9e8-48db-b71d-f5a735cd87c5 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 986.464542] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 986.464887] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.465053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.465140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.467646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.467646] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.564386] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7eac6402-6022-482b-92e4-a8c17c08633f tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 986.564386] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 986.564774] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.565112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.677420] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 986.677420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.769481] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.769663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.769730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.770692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.770692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.770926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.770926] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.770992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.771181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.771336] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.771422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.771495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.771633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.771707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.771789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.771886] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.987401] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.987628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.987628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.987862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.987927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.987985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 already deleted. [ 986.988078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.988231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.988380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.988460] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.274690] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07e38e11-5e71-4d2b-b175-0954d843dabf: rpc.has_security_group_logging(os_id): False [ 987.303966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.304143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.304195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.304460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.304594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.304880] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.305009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.305077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.305272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.305354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.305546] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.305665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.305726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.305847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.306032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.306140] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.306225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.306292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.306435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.306511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.306598] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 987.385525] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.385525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.385525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.385525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.385525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.402107] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 987.524924] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.525245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.525245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.525467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.525557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.525662] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 already deleted. [ 987.525744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.810505] env[65427]: INFO networking_nsxv3.common.synchronization [req-92554f11-9ac2-4ffb-b5cc-a66b5aeaedd8 req-7fb3871d-6540-4797-95d1-0693a0150acd tempest-ServersTestJSON-485719575 tempest-ServersTestJSON-485719575-project-member] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 987.812059] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGHEST for action security_group_members [ 987.812059] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.812304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.812304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.812478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.812733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.812978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.813090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.813256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.813385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.813528] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.966883] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 987.966883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.317153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.317153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.317153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.317153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.339498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.339641] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.339773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.339815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.340027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.340106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.340200] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 is going to be updated. [ 988.371135] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.371135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.371135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.371135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.371135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.381705] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: IN_PROGRESS for 2s [ 989.422225] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 989.422616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.394526] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 in Status: SUCCESS [ 990.394680] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 deletion is rescheduled due to dependency. [ 990.394680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.284830] env[65427]: INFO networking_nsxv3.common.synchronization [req-8e0783dc-8beb-4692-9770-8b3ed8d6801f req-296bfe10-b6ed-417e-a000-ec541d59fdc8 tempest-ImagesOneServerTestJSON-2057403856 tempest-ImagesOneServerTestJSON-2057403856-project-member] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 991.285201] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 991.285499] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.285598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.285638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.285885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.286126] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.286273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.286360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.286513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.286596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.286689] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.645234] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.645477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.645606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.645960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.646435] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.646591] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.646789] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.647065] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.647267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.647518] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.647679] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.647816] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.647968] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.648132] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.648345] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.648594] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.669068] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.669247] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.669453] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.669570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-51" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.669885] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-18e7888a-e0c0-4505-9e9c-29289e46c33b taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.670072] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.670196] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.670526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.670668] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e7888a-e0c0-4505-9e9c-29289e46c33b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.788857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.789673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.789673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.789780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.789813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.790717] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.790717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.790717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.790717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.790717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.790717] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 already deleted. [ 991.790717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.172868] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.173061] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.173112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.175016] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 18e7888a-e0c0-4505-9e9c-29289e46c33b not found, creating... [ 992.175016] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.175016] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.175016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.175561] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.175561] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.175561] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.175561] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 18e7888a-e0c0-4505-9e9c-29289e46c33b is going to be created. [ 992.197422] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.197637] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.197759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.198037] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.198271] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.198497] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.929026] env[65427]: INFO networking_nsxv3.common.synchronization [req-8e0783dc-8beb-4692-9770-8b3ed8d6801f req-3434c20a-af6c-486e-87fd-43cd6a96561b service nova] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_rules [ 992.929275] env[65427]: INFO networking_nsxv3.common.synchronization [req-8e0783dc-8beb-4692-9770-8b3ed8d6801f req-3434c20a-af6c-486e-87fd-43cd6a96561b service nova] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 992.929343] env[65427]: INFO networking_nsxv3.common.synchronization [req-8e0783dc-8beb-4692-9770-8b3ed8d6801f req-3434c20a-af6c-486e-87fd-43cd6a96561b service nova] Enqueued Resource ID: 18e7888a-e0c0-4505-9e9c-29289e46c33b with Priority: HIGHEST for action port [ 992.929884] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_rules [ 992.930768] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 992.931870] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e7888a-e0c0-4505-9e9c-29289e46c33b with Priority: HIGHEST for action port [ 992.932293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.932462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.932556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.933298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.933603] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.935264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.935450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.935555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.935779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.936015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.936162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.936267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.936454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.936585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.936709] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.938370] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-18e7888a-e0c0-4505-9e9c-29289e46c33b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.938556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.938652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.938865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.938968] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e7888a-e0c0-4505-9e9c-29289e46c33b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.441315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.441874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.442192] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.443430] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18e7888a-e0c0-4505-9e9c-29289e46c33b with status ACTIVE [ 993.443430] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.443847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.443847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.445806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.445806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.445806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.445806] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18e7888a-e0c0-4505-9e9c-29289e46c33b is going to be updated. [ 993.470442] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.470739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.470819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.471075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.472055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.472055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18e7888a-e0c0-4505-9e9c-29289e46c33b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.582997] env[65427]: INFO networking_nsxv3.common.synchronization [req-c137f675-b91a-4289-9e0c-cb85fe3ae987 req-e86da765-d0d1-4d92-9f6f-a5e4e38913a2 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 993.584425] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 993.584852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.585028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.585182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.585448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.585666] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.585803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.585893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.586113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.586236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.586376] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.948432] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.088604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.088771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.088845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.089114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.089213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.089445] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.089597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.089679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.089883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.089971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.090092] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 994.134489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.134489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.134489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.134489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.134489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.144923] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 994.156755] env[65427]: INFO networking_nsxv3.common.synchronization [None req-d0eac30e-38cb-4157-9d6f-b714a65d0feb tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 994.157851] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 994.157851] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.157851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.158089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.158206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.158290] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.304285] env[65427]: INFO networking_nsxv3.common.synchronization [None req-307d2301-32e6-4413-aa41-b35bebd27041 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 994.304910] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 994.305447] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.305447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.450318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.450472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.450721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.451126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.451287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.451407] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 is going to be created. [ 994.483455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.483607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.483749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.483945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.484156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.498684] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: UNINITIALIZED for 2s [ 994.682239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.682517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.682615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.682951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.683127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.683526] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 already deleted. [ 994.683526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.683690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.685226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.685362] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.213778] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.214035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.214123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.214442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.214564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.214707] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 already deleted. [ 995.214963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.157119] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 996.157833] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a deletion is rescheduled due to dependency. [ 996.157949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.511171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: SUCCESS [ 996.511564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.511564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.511784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.511982] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.512142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.512207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.512403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.512475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.512523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.512611] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.017930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.017930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.017930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.017930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.017930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.018545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.018545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.018545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.018545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.018545] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.232565] env[65427]: INFO networking_nsxv3.common.synchronization [req-d3a1410e-3524-44b0-96a7-318df3b2d281 req-0334ee86-f5e4-40e2-a92a-2b55e685f231 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 997.234483] env[65427]: INFO networking_nsxv3.common.synchronization [req-5c3bc0e6-e91e-471b-9fa2-73a7de42b46e req-3fa66dbb-b60b-4d33-9cad-30389fa28791 tempest-ServersTestBootFromVolume-683815655 tempest-ServersTestBootFromVolume-683815655-project-member] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 997.235476] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGHEST for action security_group_members [ 997.235786] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGHEST for action security_group_members [ 997.236328] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.236568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.236730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.237099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.237375] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.237599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.237737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.238082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.238282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.238499] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.240193] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.240309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.240450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.240734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.242466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.242661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.242773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.243073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.243238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.243414] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.521824] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b2d765d-91fb-4fe9-b7d0-06af18babd59: rpc.has_security_group_logging(os_id): False [ 997.546218] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.546646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.546646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.546741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.546833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.547227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.547227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.547400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.547452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.547535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.547758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.547852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.547914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.548087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.548156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.548397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.548501] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.548565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.548876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.548876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.548876] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 is going to be created. [ 997.635029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.635239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.635324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.635749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.635924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.652089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: IN_PROGRESS for 2s [ 997.745597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.745748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.745792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.745993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.748734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.748850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.772591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.772823] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.772956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.773034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.773295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.773387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.773485] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 is going to be updated. [ 997.776506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.776743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.776863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.777109] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.777255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.777347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.777561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.777640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.777674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 is going to be updated. [ 997.812878] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.813235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.813235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.813405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.813484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.815848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.815959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.816086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.816213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.816338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.825618] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: IN_PROGRESS for 2s [ 997.826284] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: IN_PROGRESS for 2s [ 999.666827] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: SUCCESS [ 999.667098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.838868] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 in Status: SUCCESS [ 999.838868] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 deletion is rescheduled due to dependency. [ 999.838868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.838868] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 in Status: SUCCESS [ 999.838868] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 deletion is rescheduled due to dependency. [ 999.838868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.825974] env[65427]: INFO networking_nsxv3.common.synchronization [req-76b5c7ea-4487-4c2e-b4b6-3ec19aba8584 req-dc8c72f8-dd14-4822-9967-0ca9f2537376 tempest-ImagesTestJSON-1528791264 tempest-ImagesTestJSON-1528791264-project-member] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 1001.825974] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGHEST for action security_group_members [ 1001.825974] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.825974] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.825974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.825974] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.019206] env[65427]: INFO networking_nsxv3.common.synchronization [req-2bf77eec-831e-45c8-bc46-2060778185be req-468d6fe4-d8f4-4a43-82e9-cadd5e3f0149 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1002.019917] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1002.020385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.020517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.020585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.024021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.024021] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.024021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.024021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.024021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.024021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.024021] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.327571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.327763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.327887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.328076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.328172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.328400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.328500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.328613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.328707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.328814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.328869] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be updated. [ 1002.368495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.368647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.368716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.369024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.370287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.381867] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: IN_PROGRESS for 2s [ 1002.524307] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.524615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.524615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.524748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.550037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.550335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.550457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.550525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.550737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.550829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.550923] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be updated. [ 1002.607251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.607251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.607251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.607479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.608758] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.618280] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 1002.827024] env[65427]: INFO networking_nsxv3.common.synchronization [req-88e8d227-3f0c-48ac-96d7-aa815c4cff2b req-078d5688-e916-4677-ab16-cfa81e551e95 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1002.827024] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1002.828917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.829097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.829169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.829457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.829541] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.829628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.829691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.829843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.829927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.830039] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.202971] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.203245] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.203383] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.203667] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.203920] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.206041] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.206142] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.206402] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.206624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.206777] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.206891] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.207009] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.207121] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.207324] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.207477] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.207543] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.229097] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.232790] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.232790] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.232790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.232790] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-81ed80bf-65ef-49f9-94ff-122a7355d32e taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.232790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.232790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.232790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.232790] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ed80bf-65ef-49f9-94ff-122a7355d32e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.337024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.337024] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.337024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.337024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1003.367037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.367037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.367037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.367037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.367037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.379104] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1003.736782] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.736782] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.736782] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.737114] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.737114] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.738112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 81ed80bf-65ef-49f9-94ff-122a7355d32e not found, creating... [ 1003.738112] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.738112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.738112] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.738438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.738438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.738608] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.738847] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.739111] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.739464] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.739624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.739836] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 81ed80bf-65ef-49f9-94ff-122a7355d32e is going to be created. [ 1003.761855] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.762146] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.762298] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.762612] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.762958] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.763312] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.391418] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad in Status: SUCCESS [ 1004.391738] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad deletion is rescheduled due to dependency. [ 1004.391738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.529032] env[65427]: INFO networking_nsxv3.common.synchronization [req-88e8d227-3f0c-48ac-96d7-aa815c4cff2b req-c46594d6-1ad5-482e-b45a-0e353d7a48ad service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1004.529032] env[65427]: INFO networking_nsxv3.common.synchronization [req-88e8d227-3f0c-48ac-96d7-aa815c4cff2b req-c46594d6-1ad5-482e-b45a-0e353d7a48ad service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1004.529230] env[65427]: INFO networking_nsxv3.common.synchronization [req-88e8d227-3f0c-48ac-96d7-aa815c4cff2b req-c46594d6-1ad5-482e-b45a-0e353d7a48ad service nova] Enqueued Resource ID: 81ed80bf-65ef-49f9-94ff-122a7355d32e with Priority: HIGHEST for action port [ 1004.529780] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1004.529918] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1004.530043] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ed80bf-65ef-49f9-94ff-122a7355d32e with Priority: HIGHEST for action port [ 1004.530342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.530498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.530562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.530727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.530828] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.531993] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.531993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.532225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ed80bf-65ef-49f9-94ff-122a7355d32e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.532225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.532225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.532392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.532436] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ed80bf-65ef-49f9-94ff-122a7355d32e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.628333] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 1004.628511] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 deletion is rescheduled due to dependency. [ 1004.628882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.034431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.034565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.034760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81ed80bf-65ef-49f9-94ff-122a7355d32e with status ACTIVE [ 1005.035209] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.035209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.035209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.035467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.035521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.035735] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.035865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.035933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.036115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.036230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.036393] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.036545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.036545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.036736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.036736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.036827] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81ed80bf-65ef-49f9-94ff-122a7355d32e is going to be updated. [ 1005.058151] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.058335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.058401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.058676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.058783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.058970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ed80bf-65ef-49f9-94ff-122a7355d32e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.391486] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1005.391486] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1005.391486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.391950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.391950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.392041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.392128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.392291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.392456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.392534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.393354] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.395387] env[65427]: INFO networking_nsxv3.common.synchronization [req-4bd5d8b7-cdbe-47d1-acfd-6e282537f82d req-9accc950-32da-4367-acd0-90faf5c3ec6e tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1005.396430] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1005.396601] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.396753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.396753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.397070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.397602] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.397602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.397602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.397602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.397602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.397839] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.733021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.733021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.733021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.733021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.733021] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.733021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.733021] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.733719] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.734070] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.734431] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.734670] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.734916] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.735208] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.735470] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.735706] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.735979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.755756] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.755933] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.756073] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.756264] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.756577] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-7743330c-d432-4901-8553-89e4d8bb9b2b taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.756753] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.756890] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.757227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.757381] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7743330c-d432-4901-8553-89e4d8bb9b2b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.896930] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.900470] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.900854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.900854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.900932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.900969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.901353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.901444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.901504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.901813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.901813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.901813] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 already deleted. [ 1005.901938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.259486] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.259791] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.259962] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.260353] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.261041] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.261041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 7743330c-d432-4901-8553-89e4d8bb9b2b not found, creating... [ 1006.261208] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.261427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.261583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.261934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.262179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.262581] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.262837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.262993] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.263266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.263438] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.263622] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 7743330c-d432-4901-8553-89e4d8bb9b2b is going to be created. [ 1006.303394] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.303788] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.303858] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.304163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.304423] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.304659] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.399684] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.778843] env[65427]: INFO networking_nsxv3.common.synchronization [None req-88217408-b731-44da-96f5-b751843d013b tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1006.779474] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1006.780121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.780121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.780121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.782136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.782136] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.880791] env[65427]: INFO networking_nsxv3.common.synchronization [None req-9f4aa66c-ac85-4f67-919c-db2346a21190 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1006.881744] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1006.881744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.881870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.902206] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.902410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.902459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.902658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.902750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.902859] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1006.964346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.964568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.964692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.965035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.965284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.976377] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1007.047804] env[65427]: INFO networking_nsxv3.common.synchronization [req-4bd5d8b7-cdbe-47d1-acfd-6e282537f82d req-843af008-badb-483c-8f2c-d409d594210f service nova] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 1007.047982] env[65427]: INFO networking_nsxv3.common.synchronization [req-4bd5d8b7-cdbe-47d1-acfd-6e282537f82d req-843af008-badb-483c-8f2c-d409d594210f service nova] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1007.048403] env[65427]: INFO networking_nsxv3.common.synchronization [req-4bd5d8b7-cdbe-47d1-acfd-6e282537f82d req-843af008-badb-483c-8f2c-d409d594210f service nova] Enqueued Resource ID: 7743330c-d432-4901-8553-89e4d8bb9b2b with Priority: HIGHEST for action port [ 1007.048974] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_rules [ 1007.049142] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1007.049226] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7743330c-d432-4901-8553-89e4d8bb9b2b with Priority: HIGHEST for action port [ 1007.049526] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.049649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.049728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.049914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.049998] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.053759] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.053759] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.053759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.053759] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.055067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7743330c-d432-4901-8553-89e4d8bb9b2b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.055067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.055067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.055067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.055067] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7743330c-d432-4901-8553-89e4d8bb9b2b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.270618] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.271090] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.312644] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.312859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.313030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.313341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.313500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.313670] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d569034b-409c-4fd2-a968-3cd540fb405e already deleted. [ 1007.313788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.314442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.314634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.314737] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.552991] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.552991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.555295] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.559148] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7743330c-d432-4901-8553-89e4d8bb9b2b with status ACTIVE [ 1007.559148] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.559148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.559148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.559148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.559148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.559396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.559445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.559557] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.561355] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.561355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.561355] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7743330c-d432-4901-8553-89e4d8bb9b2b is going to be updated. [ 1007.587937] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.587937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.587937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.588100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.588204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.588368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7743330c-d432-4901-8553-89e4d8bb9b2b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.839343] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.839844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.840081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.840429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.840724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.840952] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d569034b-409c-4fd2-a968-3cd540fb405e already deleted. [ 1007.841187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.059691] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.565029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.565029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.565029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.565029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.565029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.565029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 is going to be created. [ 1008.592448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.592448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.592448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.592448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.592754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.610599] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: UNINITIALIZED for 2s [ 1008.989108] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1008.989395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.989595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.989867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.990153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.990618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.990618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.990618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.990775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.990775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.990865] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.494184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.494184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.494547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.494547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.495060] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.495060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.495060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.495060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.495454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.495454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.495524] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.495585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.495710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.495810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.495981] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.496110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.496241] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.496376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.496471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.496563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.496666] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.999842] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 1010.025692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.025775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.025810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.026131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.026292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.026700] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.026700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.026834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.027030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.027030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.027223] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.027362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.027450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.027618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.027781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.027889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.027978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.028173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.028173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.028266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.028336] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1010.096297] env[65427]: INFO networking_nsxv3.common.synchronization [req-d625163f-2584-4d5e-9c6b-300d8fe1df16 req-55e56941-6ff5-4617-9dc3-4f2c9d177a75 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1010.096297] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1010.096871] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.097379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.097645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.098399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.098701] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.099120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.099404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.100140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.100140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.100140] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.124025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.124025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.124025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.124025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.124025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.142831] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1010.603869] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.620488] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: SUCCESS [ 1010.620741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.620897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.621159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.621320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.621440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.621504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.621660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.621740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.621825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.621914] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.654086] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.654293] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.654388] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.654823] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.655125] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.655307] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.655468] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.655712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.655933] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.656302] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.656302] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.656502] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.656734] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.656878] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.657045] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.657300] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.687606] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.687926] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.688081] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.688336] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.688602] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.688781] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.688902] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.689285] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.689639] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.106718] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.123780] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.196029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.196277] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.196453] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.196785] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.197039] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.197221] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 not found, creating... [ 1011.197623] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.197940] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.198177] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.198481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.198659] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.199173] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.199384] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.199513] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.199815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.199977] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.200189] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 is going to be created. [ 1011.228025] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.228025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.228025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.228025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.228025] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.230304] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.609396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.610035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.610035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.610035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.610035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.610035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1011.626397] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4c70605-cf21-41b4-b935-773c9e9944e5: rpc.has_security_group_logging(os_id): False [ 1011.647890] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.648043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.648112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.648320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.648407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.648664] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.648735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.648797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.648951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.649027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.649114] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 is going to be created. [ 1011.653127] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.653309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.653553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.653553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.653675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.666179] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1011.735028] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.735028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.735028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.735028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.735028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.751309] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: IN_PROGRESS for 2s [ 1011.979147] env[65427]: INFO networking_nsxv3.common.synchronization [req-d625163f-2584-4d5e-9c6b-300d8fe1df16 req-d4d874ed-269e-4f48-8b23-b879b1e3da0e service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1011.979372] env[65427]: INFO networking_nsxv3.common.synchronization [req-d625163f-2584-4d5e-9c6b-300d8fe1df16 req-d4d874ed-269e-4f48-8b23-b879b1e3da0e service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1011.979552] env[65427]: INFO networking_nsxv3.common.synchronization [req-d625163f-2584-4d5e-9c6b-300d8fe1df16 req-d4d874ed-269e-4f48-8b23-b879b1e3da0e service nova] Enqueued Resource ID: bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 with Priority: HIGHEST for action port [ 1011.980608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1011.980608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1011.980608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 with Priority: HIGHEST for action port [ 1011.981067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.981936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.981936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.981936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.981936] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.985269] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.985269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.985860] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.985860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.986039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.987384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.987384] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.157093] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1012.157680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.486509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.486509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.490795] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 with status ACTIVE [ 1012.490795] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.490795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.490795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.490795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.490795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.491150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.491371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.491602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.491949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.491949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.492231] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.492397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.492496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.492941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.492941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.492941] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937 is going to be updated. [ 1012.527585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.527805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.527805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.528123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.528599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.528599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc1ae5da-24f9-4a5a-bbd4-f1ad5c229937" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.766024] env[65427]: INFO networking_nsxv3.common.synchronization [req-0ac27134-36c0-4256-9322-ba0175fa2bad req-0411e19c-0721-4687-92af-d70316309572 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1012.766797] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1012.767381] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.767637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.767720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.768043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.768266] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.768675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.768861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.769014] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.164741] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.165121] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.165121] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.165471] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.165832] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.166047] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.166223] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.166477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.166655] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.166912] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.167110] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.167274] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.167438] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.167533] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.167641] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.167772] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.188137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.188310] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.188446] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.188627] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.188948] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.189141] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.189499] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.189588] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.189733] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.272296] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.272497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.272572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.272795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.272886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.273259] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.273259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.273473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.273685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.273934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.274022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 already deleted. [ 1013.274177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.677912] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1013.678644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.678878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.682587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.682863] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.682999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.683089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.684443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.684560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.684705] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.693077] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.693274] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.693453] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.694051] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.694269] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.694538] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 not found, creating... [ 1013.694904] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.695109] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.695359] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.695677] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.696206] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.696670] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.696919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.697154] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.697718] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.697940] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.698181] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 is going to be created. [ 1013.727312] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.727557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.727779] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.728054] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.728362] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.728593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.764555] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: SUCCESS [ 1013.764816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.133785] env[65427]: INFO networking_nsxv3.common.synchronization [None req-bb37f0d1-c491-4e77-a3a6-0f98d51afbd7 None None] Enqueued Resource ID: c6b7c21c-78b5-4999-855d-047e0e22a4a1 with Priority: HIGHEST for action port [ 1014.135288] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b7c21c-78b5-4999-855d-047e0e22a4a1 with Priority: HIGHEST for action port [ 1014.135288] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b7c21c-78b5-4999-855d-047e0e22a4a1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.135523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b7c21c-78b5-4999-855d-047e0e22a4a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.135611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b7c21c-78b5-4999-855d-047e0e22a4a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.136026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b7c21c-78b5-4999-855d-047e0e22a4a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.136152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b7c21c-78b5-4999-855d-047e0e22a4a1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.187117] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [req-0ac27134-36c0-4256-9322-ba0175fa2bad req-068721ec-ef38-4cf8-8048-eb39dfa60de2 service nova] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [req-0ac27134-36c0-4256-9322-ba0175fa2bad req-068721ec-ef38-4cf8-8048-eb39dfa60de2 service nova] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [req-0ac27134-36c0-4256-9322-ba0175fa2bad req-068721ec-ef38-4cf8-8048-eb39dfa60de2 service nova] Enqueued Resource ID: 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 with Priority: HIGHEST for action port [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_rules [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1014.489732] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 with Priority: HIGHEST for action port [ 1014.490454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.490454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.490454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.490994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.490994] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.493283] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.493283] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.493283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.493283] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.493921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.494719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.494719] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.639765] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6b7c21c-78b5-4999-855d-047e0e22a4a1 [ 1014.640015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.640221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.640303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.640466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.640556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.640668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6b7c21c-78b5-4999-855d-047e0e22a4a1 already deleted. [ 1014.641054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b7c21c-78b5-4999-855d-047e0e22a4a1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.689598] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.001027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.002464] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.002464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.003261] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 with status ACTIVE [ 1015.003261] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.003849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.003928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.004173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.004468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.004554] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.004619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.004684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.004865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.004973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.005175] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.005290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.005582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.005582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.005582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.005691] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9 is going to be updated. [ 1015.035048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.035434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.035434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.035668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.035847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.036057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f9a4d3a-88d9-49b1-bff4-5f4f42ea19c9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.194155] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.194155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.194155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.194620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.194620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.194620] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1015.228254] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.228449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.228492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.228759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.228974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.241741] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1015.503855] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.006947] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.007156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.007236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.007446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.007537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.007636] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 is going to be created. [ 1016.036048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.036264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.036264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.036870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.036870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.047711] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: UNINITIALIZED for 2s [ 1016.757908] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7c620213-9e85-4372-b712-53496465d0e5 None None] Enqueued Resource ID: 6d60593d-9d91-471d-b723-fec7b4294a75 with Priority: HIGHEST for action port [ 1016.758492] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d60593d-9d91-471d-b723-fec7b4294a75 with Priority: HIGHEST for action port [ 1016.758934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d60593d-9d91-471d-b723-fec7b4294a75 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.759102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d60593d-9d91-471d-b723-fec7b4294a75" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.759184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d60593d-9d91-471d-b723-fec7b4294a75" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.759520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d60593d-9d91-471d-b723-fec7b4294a75" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.759608] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d60593d-9d91-471d-b723-fec7b4294a75',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.253080] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1017.253388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.253612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.253914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.254656] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.254656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.254656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.254656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.254656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.254929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.254929] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.262618] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d60593d-9d91-471d-b723-fec7b4294a75 [ 1017.262758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.262989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.263097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.263356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.263510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.263597] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d60593d-9d91-471d-b723-fec7b4294a75 already deleted. [ 1017.263705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d60593d-9d91-471d-b723-fec7b4294a75" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.758397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.758814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.758814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.758814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.758933] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.759036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.759094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.759238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.759308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.759414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.759575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.760821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.760821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.760821] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.058776] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: SUCCESS [ 1018.058776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.058973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.059232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.059582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.059753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.059866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.060085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.060341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.060472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.060621] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.262979] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 1018.285153] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.285455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.285455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.285633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.285727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.285947] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.286059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.286125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.286302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.286386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.286584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.286684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.286771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.286921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.287033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.287223] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.287342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.287400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.287553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.287617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.287707] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1018.356393] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.356728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.356728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.356874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.357012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.367863] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1018.563699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.066724] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45c1be55-d441-4f27-a369-9d34ec40f623: rpc.has_security_group_logging(os_id): False [ 1019.103861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.105558] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.105558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.106072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.106072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.106072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 is going to be created. [ 1019.177359] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.178714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.179039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.179138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.180157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.194424] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: IN_PROGRESS for 2s [ 1019.851037] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-292c01e1-ed96-4edd-89fd-b13d7c3f4e47 tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1019.851037] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1019.851037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.851037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.851037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.851801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.852111] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.852693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.853271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.853590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.854775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.854775] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.356246] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.356671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.356671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.356779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.356829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.357808] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.357808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.357808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.357808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.357808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.357808] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1020.368029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.368325] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.368421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.368635] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.368949] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.369507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.369989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.371064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.371064] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.371064] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.371064] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.371284] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.371284] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.371478] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.371763] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.371860] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.399769] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.399925] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.399990] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.400230] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.400631] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-79251581-676c-40f0-b6fc-5c2e9b33e9db taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.400923] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.401024] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.401390] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.401559] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79251581-676c-40f0-b6fc-5c2e9b33e9db',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.403318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.404497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.404497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.404497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.404497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.407226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1020.407226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.414343] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1020.906477] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.906685] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.906848] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.907215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.907410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.907604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 79251581-676c-40f0-b6fc-5c2e9b33e9db not found, creating... [ 1020.907955] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.908175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.908393] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.908675] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.908829] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.909439] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.909717] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.909878] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.910186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.910375] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.910576] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 79251581-676c-40f0-b6fc-5c2e9b33e9db is going to be created. [ 1020.937047] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.941072] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.941072] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.941072] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.941398] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.942217] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.209621] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: SUCCESS [ 1021.209621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.659669] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-3c7258bc-59d4-4b4d-8331-84293ccfbb46 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 1021.660745] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-3c7258bc-59d4-4b4d-8331-84293ccfbb46 service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1021.660745] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-3c7258bc-59d4-4b4d-8331-84293ccfbb46 service nova] Enqueued Resource ID: 79251581-676c-40f0-b6fc-5c2e9b33e9db with Priority: HIGHEST for action port [ 1021.661215] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 1021.661485] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1021.661631] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79251581-676c-40f0-b6fc-5c2e9b33e9db with Priority: HIGHEST for action port [ 1021.661956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.662151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.662264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.662724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.662941] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.664013] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.664166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.664350] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-79251581-676c-40f0-b6fc-5c2e9b33e9db taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.664512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.664638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.664750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.664832] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79251581-676c-40f0-b6fc-5c2e9b33e9db',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.843935] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ee95e343-a59c-47bf-94da-1c54c671915a tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1021.844713] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1021.845222] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.845446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.845541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.845854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.846032] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.149730] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-58a93c49-0416-403f-b4e7-b01e0efdd5e3 tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1022.151056] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1022.151702] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.151847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79251581-676c-40f0-b6fc-5c2e9b33e9db with status ACTIVE [ 1022.168031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.168031] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.168031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.168723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.168723] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.168723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.168723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.168723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.168942] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79251581-676c-40f0-b6fc-5c2e9b33e9db is going to be updated. [ 1022.180085] env[65427]: INFO networking_nsxv3.common.synchronization [None req-8fb47b08-19c8-4a76-9939-a28ddeae091b tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1022.180620] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1022.180999] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.181117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.197921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.198133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.198195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.198971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.199088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.199225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79251581-676c-40f0-b6fc-5c2e9b33e9db" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.370799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.370799] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd already deleted. [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.370799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.370799] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.430863] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1022.430863] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d deletion is rescheduled due to dependency. [ 1022.430863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.431242] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.431504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.431785] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.431973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.432234] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.432363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.432465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.432608] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.592502] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.592738] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.592880] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.593193] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.593474] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.593632] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.593889] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.594133] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.594287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.594502] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.594647] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.594810] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.594877] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.594982] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.595100] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.595233] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.618670] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.618843] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.618995] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.619186] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-624" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.619512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-c70b419c-6977-43eb-b13c-ec123190fe87 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.619700] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.619799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.620190] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.620443] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c70b419c-6977-43eb-b13c-ec123190fe87',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.896106] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.896544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.896544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.896638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.896933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.896933] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd already deleted. [ 1022.896933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.936441] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.123344] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.123650] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.123865] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.124363] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.124582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.124804] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port c70b419c-6977-43eb-b13c-ec123190fe87 not found, creating... [ 1023.125275] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.125549] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.125680] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.126038] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.126291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.126687] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.126918] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.127086] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.127385] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.127704] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.127797] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: c70b419c-6977-43eb-b13c-ec123190fe87 is going to be created. [ 1023.152343] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.152689] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.152974] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.153383] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.153709] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.154360] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.232122] env[65427]: INFO networking_nsxv3.common.synchronization [None req-a3336df0-f3d3-4cb4-b4c2-0662be1e886e tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1023.232723] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1023.233403] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.233478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.233521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.233757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.233846] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.440155] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.519280] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0c91fc8c-aa10-4337-8b31-e63e027981c0 tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1023.520182] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1023.520763] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.521012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.755985] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.756154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.756216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.756410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.756561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.756672] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb already deleted. [ 1023.756776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.757290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.757290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.757452] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.875787] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-61343fc7-9024-42f9-9656-7522009818bc service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 1023.876171] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-61343fc7-9024-42f9-9656-7522009818bc service nova] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1023.876369] env[65427]: INFO networking_nsxv3.common.synchronization [req-7cbd4d69-bab0-4c2a-be5d-7a132ec571a2 req-61343fc7-9024-42f9-9656-7522009818bc service nova] Enqueued Resource ID: c70b419c-6977-43eb-b13c-ec123190fe87 with Priority: HIGHEST for action port [ 1023.876984] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_rules [ 1023.877175] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1023.877240] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c70b419c-6977-43eb-b13c-ec123190fe87 with Priority: HIGHEST for action port [ 1023.877500] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.878143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.878143] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.878143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.880323] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c70b419c-6977-43eb-b13c-ec123190fe87 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.880323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.880589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.880589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.880706] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c70b419c-6977-43eb-b13c-ec123190fe87',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.941823] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.942313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.942313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.942313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.942484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.942484] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1023.974917] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.977618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.977618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.977618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.977618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.002600] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1024.281888] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.281888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.281888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.282169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.282293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.282487] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb already deleted. [ 1024.282546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.382571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c70b419c-6977-43eb-b13c-ec123190fe87 with status ACTIVE [ 1024.383530] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.383702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.383772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.384534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.384713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.384979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.385137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.385209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.385450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.385562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.385920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.385920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.386098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.386136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.386230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.386923] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c70b419c-6977-43eb-b13c-ec123190fe87 is going to be updated. [ 1024.410670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.411206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.411206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.411341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.411632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.411790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c70b419c-6977-43eb-b13c-ec123190fe87" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.567297] env[65427]: INFO networking_nsxv3.common.synchronization [req-d561d816-3846-4ad5-bc17-082fb58dd595 req-9462e650-40c0-4ede-a65b-fc53b00c1234 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1024.567909] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1024.568685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.568826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.568898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.569153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.569526] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.569526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.569628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.569763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.569852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.569974] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.072297] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.072297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.072297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.072662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.072746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.073018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.073199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.073358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.073522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.073522] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be updated. [ 1025.105165] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.105363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.105685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.105754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.105920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.111308] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.111496] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.111614] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.112114] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.112233] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.112361] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.112488] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.112738] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.112890] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.113104] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.113251] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.113584] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.113584] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.113742] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.113742] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.113878] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.118018] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 1025.134350] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.134602] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.134831] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.134987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-175" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.135372] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.135590] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.135671] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.136168] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.136492] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb2d8e7f-7b68-479e-a9da-df7f6d61c044',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.639228] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.639463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.639578] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.639875] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.640042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.640200] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port fb2d8e7f-7b68-479e-a9da-df7f6d61c044 not found, creating... [ 1025.640512] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.640663] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.640727] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.640944] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.641133] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.641433] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.641624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.641788] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.642013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.642163] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.642304] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: fb2d8e7f-7b68-479e-a9da-df7f6d61c044 is going to be created. [ 1025.665579] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.665820] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.665922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.666219] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.666483] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.666772] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.014183] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1026.014389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.014572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.014794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.015360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.015360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.015640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.015640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.015733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.015817] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.472904] env[65427]: INFO networking_nsxv3.common.synchronization [req-d561d816-3846-4ad5-bc17-082fb58dd595 req-e9ac1947-1cbc-4f95-abd7-769b96f4ff11 service nova] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 1026.473703] env[65427]: INFO networking_nsxv3.common.synchronization [req-d561d816-3846-4ad5-bc17-082fb58dd595 req-e9ac1947-1cbc-4f95-abd7-769b96f4ff11 service nova] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1026.473703] env[65427]: INFO networking_nsxv3.common.synchronization [req-d561d816-3846-4ad5-bc17-082fb58dd595 req-e9ac1947-1cbc-4f95-abd7-769b96f4ff11 service nova] Enqueued Resource ID: fb2d8e7f-7b68-479e-a9da-df7f6d61c044 with Priority: HIGHEST for action port [ 1026.474362] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_rules [ 1026.474569] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1026.474710] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2d8e7f-7b68-479e-a9da-df7f6d61c044 with Priority: HIGHEST for action port [ 1026.475068] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.475233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.475348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.475599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.475724] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.478781] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.478882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.479082] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.479192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.479251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.479441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.479751] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb2d8e7f-7b68-479e-a9da-df7f6d61c044',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.518012] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.979207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.979347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.984862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb2d8e7f-7b68-479e-a9da-df7f6d61c044 with status ACTIVE [ 1026.985157] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.985386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.985474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.985681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.985773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.985955] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.986066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.986128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.986299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.986395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.986587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.986703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.986742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.986871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.986946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.987045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb2d8e7f-7b68-479e-a9da-df7f6d61c044 is going to be updated. [ 1027.012019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.012244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.012244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.012544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.012706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.012871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb2d8e7f-7b68-479e-a9da-df7f6d61c044" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.020508] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.129232] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 1027.129533] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 deletion is rescheduled due to dependency. [ 1027.129667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.129920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.130332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.130776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.130893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.131016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.131565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.131794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.131845] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.524868] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.525370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.525370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.525370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.525826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.525908] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1027.589433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.589433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.589433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.589769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.589769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.606142] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1027.635443] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.137939] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.640512] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.640957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.640957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.640957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.641148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.641212] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be updated. [ 1028.681864] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.682113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.682209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.682577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.682821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.694614] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 1029.617258] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1029.617579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.617839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.618206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.618500] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.618700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.618809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.619115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.619231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.619381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.619539] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.620735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.620938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.621154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.621325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.621447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.621624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.621723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.621838] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.698987] env[65427]: INFO networking_nsxv3.common.synchronization [req-3c004a1f-f491-480c-8ba3-b61db236d9d7 req-faddfa6c-7265-470e-804d-e7d144079553 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1029.700122] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1029.700407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.700573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.700696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.700986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.701218] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.701347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.701436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.701655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.702117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.702117] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.124461] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.124640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.124857] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.204046] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.627523] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.707097] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 1030.707556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.707805] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.708906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.709521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.709521] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.709705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.709757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.709961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.710099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.710282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.710427] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.131076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.131453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.131453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.131796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.132037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.132336] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1031.175731] env[65427]: INFO networking_nsxv3.common.synchronization [req-9e4d7139-993b-4948-b966-7a9ef5e8a93b req-9bd960e0-7364-4667-907c-29d9991e52e2 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1031.176328] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1031.176672] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.177884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.177969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.178227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.178429] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.178600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.178600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.178782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.178909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.179060] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.181792] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.181928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.181928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.183053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.183053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.193588] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1031.215035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.215035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.215035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.215035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.215035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.215035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1031.215035] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.273708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.274145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.274145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.274404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.274470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.286709] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1031.562581] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.562843] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.562935] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.563247] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.563570] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.563697] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.563837] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.564081] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.564231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.564474] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.564654] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.564773] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.564881] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.564995] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.565114] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.565262] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.586160] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.586412] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.586547] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.586740] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.587132] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-f47d05fc-c453-4162-8101-499580fff1cb taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.587337] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.587481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.587880] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.588035] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47d05fc-c453-4162-8101-499580fff1cb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.684879] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.685078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.685144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.685731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.685731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.685826] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.685910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.685910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.686058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.686131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.686359] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d569034b-409c-4fd2-a968-3cd540fb405e already deleted. [ 1031.686547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.719062] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e65cad1-7b76-434e-8bda-983c5b0b7e56: rpc.has_security_group_logging(os_id): False [ 1031.739712] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.739712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.739712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.740113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.740113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.740339] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.740480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.740555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.740705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.740783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.740865] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be updated. [ 1031.831618] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.831866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.831957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.832213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.832404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.850839] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 1032.091188] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.091511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.091636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.091955] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.092117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.092302] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port f47d05fc-c453-4162-8101-499580fff1cb not found, creating... [ 1032.092605] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.092803] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.092960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.093218] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.093387] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.093736] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.093914] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.094046] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.094341] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.094462] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.094604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: f47d05fc-c453-4162-8101-499580fff1cb is going to be created. [ 1032.120467] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.120735] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.120947] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.121286] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.121517] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.121773] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.847652] env[65427]: INFO networking_nsxv3.common.synchronization [req-9e4d7139-993b-4948-b966-7a9ef5e8a93b req-c49f6c23-50b6-4f27-9c4b-18be9784b30f service nova] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1032.848014] env[65427]: INFO networking_nsxv3.common.synchronization [req-9e4d7139-993b-4948-b966-7a9ef5e8a93b req-c49f6c23-50b6-4f27-9c4b-18be9784b30f service nova] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1032.848237] env[65427]: INFO networking_nsxv3.common.synchronization [req-9e4d7139-993b-4948-b966-7a9ef5e8a93b req-c49f6c23-50b6-4f27-9c4b-18be9784b30f service nova] Enqueued Resource ID: f47d05fc-c453-4162-8101-499580fff1cb with Priority: HIGHEST for action port [ 1032.848732] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_rules [ 1032.848873] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1032.848975] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47d05fc-c453-4162-8101-499580fff1cb with Priority: HIGHEST for action port [ 1032.850142] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.850142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.850142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.850142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.850142] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.851160] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.851743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.851814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.852032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.852203] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.852332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.852426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.852521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.852616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.852700] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.854036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f47d05fc-c453-4162-8101-499580fff1cb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.854036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.854036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.854183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.854183] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47d05fc-c453-4162-8101-499580fff1cb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.204193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1033.204454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.204655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.204946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.205182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.205381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.205475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.205662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.205766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.205844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.206040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.206150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.206205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.206432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.206591] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.206714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.206810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.207028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.207133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.207232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.207344] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.301922] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1033.302244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.355864] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.358022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.358022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.358022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f47d05fc-c453-4162-8101-499580fff1cb with status ACTIVE [ 1033.358022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.358022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.358022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.358430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.358430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.358578] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.358656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.358732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.358964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.359103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.359296] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.359452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.359516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.359654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.359767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.359840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f47d05fc-c453-4162-8101-499580fff1cb is going to be updated. [ 1033.386125] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.386125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.386125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.386482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.386482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.386822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f47d05fc-c453-4162-8101-499580fff1cb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.636591] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4ebc39f-1fc2-47f5-9a4c-1a8f34969ba5 req-2bc6a384-7801-4bcf-aad6-0b5b5d15967b tempest-InstanceActionsV221TestJSON-1132591777 tempest-InstanceActionsV221TestJSON-1132591777-project-member] Enqueued Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1033.636591] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1033.636591] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.636749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.636749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.638550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.638550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.638550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.638550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.638550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.638550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.638550] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.710032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd70ac25-12dc-445f-bc13-c1a6930fbf5d: rpc.has_security_group_logging(os_id): False [ 1033.729956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.730166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.730247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.730480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.730624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.730877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.730877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.731137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.731260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.731355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.731562] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.731679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.731754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.731931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.732058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.732276] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.732460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.732460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.732593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.732685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.732780] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1033.801912] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.802196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.802281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.802507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.802661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.819850] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1033.863702] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.877425] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 1033.877425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.040046] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.040504] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-842" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.040779] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-842" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.041227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-842" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.041629] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.041930] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.042167] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.042492] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.042742] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.045150] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.045150] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.045150] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.045150] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.045150] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.045150] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.045150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.067286] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.067862] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.070495] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.070495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-842" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.070495] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-35d4f76e-fb45-468f-8e6c-0399c0d0b631 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.070495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.070495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.070495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.070495] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d4f76e-fb45-468f-8e6c-0399c0d0b631',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.141353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.141577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.141629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.141825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.141911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.142123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.142217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.142335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.142429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.142505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.142691] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 already deleted. [ 1034.142691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.210118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.210289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.210360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.210595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.210865] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.365944] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.366187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.366257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.366492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.366598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.366693] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d569034b-409c-4fd2-a968-3cd540fb405e is going to be created. [ 1034.391201] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.392239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.392239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.392239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.392239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.402990] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: UNINITIALIZED for 2s [ 1034.572205] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.572585] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.572722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.573047] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.573262] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.573533] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 35d4f76e-fb45-468f-8e6c-0399c0d0b631 not found, creating... [ 1034.573890] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.574082] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.574203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.574464] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.574608] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.574947] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.575115] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.575233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.575530] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.575711] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.575855] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 35d4f76e-fb45-468f-8e6c-0399c0d0b631 is going to be created. [ 1034.598970] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.599320] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.599475] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.599921] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.600312] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.600632] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.713681] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.216649] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.377838] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4ebc39f-1fc2-47f5-9a4c-1a8f34969ba5 req-b265f801-00ca-4c01-b7c9-63adfe2fa7f4 service nova] Enqueued Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_rules [ 1035.378060] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4ebc39f-1fc2-47f5-9a4c-1a8f34969ba5 req-b265f801-00ca-4c01-b7c9-63adfe2fa7f4 service nova] Enqueued Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1035.378218] env[65427]: INFO networking_nsxv3.common.synchronization [req-c4ebc39f-1fc2-47f5-9a4c-1a8f34969ba5 req-b265f801-00ca-4c01-b7c9-63adfe2fa7f4 service nova] Enqueued Resource ID: 35d4f76e-fb45-468f-8e6c-0399c0d0b631 with Priority: HIGHEST for action port [ 1035.378806] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_rules [ 1035.379450] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1035.379639] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35d4f76e-fb45-468f-8e6c-0399c0d0b631 with Priority: HIGHEST for action port [ 1035.380390] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.380390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.380390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.380796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.381278] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.382459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.382459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.383110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.383524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.383767] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.385216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.385216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.385216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.385216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.385216] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.385920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-35d4f76e-fb45-468f-8e6c-0399c0d0b631 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.387684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.387684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.387684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.387954] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d4f76e-fb45-468f-8e6c-0399c0d0b631',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.719083] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1035.719153] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1035.835548] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1035.835697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.835877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.836115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.836209] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.892452] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.893903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.894068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.894267] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35d4f76e-fb45-468f-8e6c-0399c0d0b631 with status ACTIVE [ 1035.894469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.894622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.894709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.894930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.895058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.895260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.895418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.895511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.895727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.895848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.896040] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.896405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.896405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.896405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.896610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.896610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35d4f76e-fb45-468f-8e6c-0399c0d0b631 is going to be updated. [ 1035.921779] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.921939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.922010] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.922219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.922361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.922523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35d4f76e-fb45-468f-8e6c-0399c0d0b631" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.338617] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.338617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.338617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.339632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.339632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.339632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.339632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.339811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.339811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.339885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.340033] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.399012] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.416221] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: SUCCESS [ 1036.416221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.416494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.416646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.416940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.417184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.417259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.417623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.417730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.417789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.417835] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.839438] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.839705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.839772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.840036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.852247] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1036.853186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.854525] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1036.855830] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.856255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.856255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.856441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.856563] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.856705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.856787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.856981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.857101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.857208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.857380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.857503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.857581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.857785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.858042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.858134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.858223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.858428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.858548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.858673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.858793] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.892362] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.892524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.892594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.892797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.904619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.905381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1036.905501] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1036.905634] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1036.907131] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.907290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.907387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.907620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.907720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.907829] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 is going to be created. [ 1036.925239] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.942023] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.942023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.942023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.942023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.942023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.952583] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: UNINITIALIZED for 2s [ 1036.956599] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.956794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.956843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.957035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.958624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.958878] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1037.075559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.075842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.075947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.076114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.076496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.076808] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1037.166668] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.166902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.166902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.167148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.167456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.167790] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1037.167896] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'cc0cbb36-d62c-40ce-9e79-61f04e36627f', '546f1ff4-ef91-4671-86b3-d15ea6055715', 'dbe90e39-abbd-4d07-9021-eedecd7a9539', 'fd70ac25-12dc-445f-bc13-c1a6930fbf5d', 'a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a', 'ef110958-8d53-4daf-a376-677eb87ffe7f', '1bdf134a-d29c-4b39-8d6f-906721fa578b', 'fa68a58d-6f8b-44f5-b4ba-09baa1302d0a', '876f3d94-1c89-4fc5-91b9-bdd8347c716a', 'a6ac5c0f-07e4-483f-9add-e9bd5d48447e', '07e38e11-5e71-4d2b-b175-0954d843dabf', 'c75cceb8-4b60-4a51-8efb-b3b64b024d41', 'af559c94-c3c8-4ec7-9d79-d7e3d84241ba', '8b2d765d-91fb-4fe9-b7d0-06af18babd59', '54fe1b7a-483b-4522-ab83-ced21005a9ad', 'c8a63f06-9975-49cd-b7a4-1fc94db58876', 'b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd', '4990f2fc-b7cf-4fec-8da8-647b0eb8509c', '3085df7e-1c09-4942-ba27-49d63274ac56', 'a8dbec4d-8461-4cc1-9978-3a0a69ea030c', '45c1be55-d441-4f27-a369-9d34ec40f623', 'efd36953-3031-481f-ae25-8e10517a449e', 'a9b48d05-4eaa-4bc3-a4df-b76973da2f83', '4c3613c9-fe90-4521-87ed-64503d04b3d5', '07731512-1a84-409c-8aa3-ceec6c6e184e', 'a66c3424-adb0-472b-bb3b-fbb14607817b', '3b945fd5-1333-4892-be63-1784a8a66349', '7abbe624-4b85-4277-bdd0-ed749e166fc9', '2c8bca44-f080-48fc-9d94-91ea357c71c7', '2f440566-de23-4d5d-b5b9-fdddf6cee691', '69f47490-5211-4c8e-9e0a-b7d44c25960f', '6e65cad1-7b76-434e-8bda-983c5b0b7e56', '2caa26d9-b324-42d2-886a-42215d3c4faf', '9f63122d-80d5-406e-9516-33dde99d684a', 'a4c70605-cf21-41b4-b935-773c9e9944e5', '974a55e0-fc07-407b-9d34-07e598ec3f15', '5de73072-1420-4348-9a8f-7aea1d3f3f89', 'e21c17b3-5a69-411a-ae70-4a3d9c8d81a8', 'e055f6e8-5bdf-4d73-ac15-366894643fcc', '170e7804-bd59-4b8d-a494-3a73bf406102', 'f87de95f-23bb-4bc4-a0d9-8c1ba39407ad', '584eb45a-7106-4759-8924-ff61fcdd399f', 'c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf', '0d451ec0-7db8-47cf-a4b7-45518e01097b', '511ffa69-7259-47ba-91d1-ab46e4d80bcc'} {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.168022] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1037.192855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.193147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.193147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.193465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.193629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.193777] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1037.193868] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.193944] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1037.314662] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.314886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.314886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.315106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.316115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.316373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1037.316482] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.316566] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1037.316636] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1037.316773] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1037.316820] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGH for action security_group_rules [ 1037.316858] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1037.316926] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGH for action security_group_rules [ 1037.316990] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGH for action security_group_rules [ 1037.317066] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGH for action security_group_rules [ 1037.317127] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGH for action security_group_rules [ 1037.317223] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 1037.317264] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGH for action security_group_rules [ 1037.317301] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGH for action security_group_rules [ 1037.317366] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGH for action security_group_rules [ 1037.317447] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGH for action security_group_rules [ 1037.317489] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGH for action security_group_rules [ 1037.317544] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGH for action security_group_rules [ 1037.317606] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGH for action security_group_rules [ 1037.317667] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGH for action security_group_rules [ 1037.317722] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGH for action security_group_rules [ 1037.317784] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGH for action security_group_rules [ 1037.317846] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGH for action security_group_rules [ 1037.317908] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGH for action security_group_rules [ 1037.317980] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGH for action security_group_rules [ 1037.318087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.362288] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd70ac25-12dc-445f-bc13-c1a6930fbf5d: rpc.has_security_group_logging(os_id): False [ 1037.382461] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.382712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.382712] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.382911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.403577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.404815] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.404815] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.404815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.405127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.405127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.405127] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.405232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.405232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.405704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.405704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.405704] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1037.427207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d569034b-409c-4fd2-a968-3cd540fb405e: rpc.has_security_group_logging(os_id): False [ 1037.448383] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.448500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.448657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.448868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.448991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.449352] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.449490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.449578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.449795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.449900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.450460] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d569034b-409c-4fd2-a968-3cd540fb405e is going to be created. [ 1037.493676] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.493676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.493676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.493676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.493676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.510068] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1037.519683] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.519683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.519683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.519945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.520363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.549038] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: IN_PROGRESS for 2s [ 1037.851633] env[65427]: INFO networking_nsxv3.common.synchronization [req-8dd6dd2d-cba8-4600-828b-3fc5b11d0418 req-9ef3951b-ff22-4f00-b6e3-c22a5a26bcb2 tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 1037.852653] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc with Priority: HIGHEST for action security_group_members [ 1037.853360] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f with Priority: HIGH for action security_group_rules [ 1037.853360] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 with Priority: HIGH for action security_group_rules [ 1037.853360] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 1037.853360] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad with Priority: HIGH for action security_group_rules [ 1037.853608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c with Priority: HIGH for action security_group_rules [ 1037.853608] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3085df7e-1c09-4942-ba27-49d63274ac56 with Priority: HIGH for action security_group_rules [ 1037.853716] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c with Priority: HIGH for action security_group_rules [ 1037.853888] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd with Priority: HIGH for action security_group_rules [ 1037.854350] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGH for action security_group_rules [ 1037.854423] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 with Priority: HIGH for action security_group_rules [ 1037.854534] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba with Priority: HIGH for action security_group_rules [ 1037.854949] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 with Priority: HIGH for action security_group_rules [ 1037.854949] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGH for action security_group_rules [ 1037.854949] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGH for action security_group_rules [ 1037.855120] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a with Priority: HIGH for action security_group_rules [ 1037.855241] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef110958-8d53-4daf-a376-677eb87ffe7f with Priority: HIGH for action security_group_rules [ 1037.856016] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a with Priority: HIGH for action security_group_rules [ 1037.856016] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGH for action security_group_rules [ 1037.856183] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1037.856241] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGH for action security_group_rules [ 1037.857189] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-511ffa69-7259-47ba-91d1-ab46e4d80bcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.857189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.857189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.857189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.857419] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.857491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.857546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.859760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.859847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.859954] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('511ffa69-7259-47ba-91d1-ab46e4d80bcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.861254] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.861383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.861452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.861655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.861759] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc0cbb36-d62c-40ce-9e79-61f04e36627f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.863940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe90e39-abbd-4d07-9021-eedecd7a9539 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.864116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.864210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.864448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.864562] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe90e39-abbd-4d07-9021-eedecd7a9539',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.865911] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.866114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.866248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.866539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.866695] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.874057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54fe1b7a-483b-4522-ab83-ced21005a9ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.874057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.874057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.874057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.874057] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54fe1b7a-483b-4522-ab83-ced21005a9ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.874057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.874677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.874677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.874677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.874677] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8dbec4d-8461-4cc1-9978-3a0a69ea030c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.875730] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3085df7e-1c09-4942-ba27-49d63274ac56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.875730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.875877] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.875963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.876112] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3085df7e-1c09-4942-ba27-49d63274ac56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.878385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.878596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.878676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.878794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.878871] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4990f2fc-b7cf-4fec-8da8-647b0eb8509c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.880297] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.880297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.880521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.881016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.881124] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.883660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.883660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.883660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.883873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.883873] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.887062] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8a63f06-9975-49cd-b7a4-1fc94db58876 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.887207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.887207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.887564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.887564] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8a63f06-9975-49cd-b7a4-1fc94db58876',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.888510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.888818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.888818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.888924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.892075] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af559c94-c3c8-4ec7-9d79-d7e3d84241ba',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.892075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.892075] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75cceb8-4b60-4a51-8efb-b3b64b024d41',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.892075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.892075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.892075] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.892642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.892895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.892973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.893238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.893340] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.894163] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.894562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.894672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.894859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.895353] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('876f3d94-1c89-4fc5-91b9-bdd8347c716a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.897057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef110958-8d53-4daf-a376-677eb87ffe7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.897057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.897057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.897057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.897057] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef110958-8d53-4daf-a376-677eb87ffe7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.898715] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.898715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.901199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.901405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.901488] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa68a58d-6f8b-44f5-b4ba-09baa1302d0a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.902529] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.903583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.903583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.903583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.903583] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.904525] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.904525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.904525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.904525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.904525] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.905150] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.905779] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.908926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.909343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.909343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.909444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.936135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.936505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.936710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.936835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.939231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.939231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.939231] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc is going to be updated. [ 1037.981590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.981768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.981832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.982819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.982819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.995724] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: IN_PROGRESS for 2s [ 1038.356844] env[65427]: INFO networking_nsxv3.common.synchronization [req-09e181c8-3a38-4b31-9d90-84b32cd80ac4 req-9bf1b150-f874-49c2-b15f-36891d9402e3 tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1038.357603] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1038.357786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.357945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.358051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.358734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.358983] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.359129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.359197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.359372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.359539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.359589] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.388149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.388446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.388446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.390027] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.390027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.390027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.407549] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408118] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.409883] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.409883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.409883] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.412651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.412651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.412651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.412870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.413036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.413280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.413390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.413604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.413750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.413951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.414107] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.425409] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.425666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.425666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.425888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.426063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.426163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.426224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.426837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.426951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.427027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.427152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.431293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.431673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.431673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.431814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.431930] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.431994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.432376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.432376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.432376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.432503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.432672] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.444892] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.445172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.445172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.445653] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.445722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.445780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.445941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.446038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.446129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.446278] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.446467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.446539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.448830] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.448830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.448830] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.483116] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.483332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.483396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.483562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.485825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.485939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.489684] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.489866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.490806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.490961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.491657] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.491763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.492557] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.492718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.493347] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.493445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.494226] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.494343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.499265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.499265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.499265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.499265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.499265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.499265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.499265] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.499265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.499265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501649] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.501649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.501649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.506934] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.507428] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.507944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.512703] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.512968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.513095] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 876f3d94-1c89-4fc5-91b9-bdd8347c716a is going to be deleted. [ 1038.514131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.514383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.532997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.533159] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc0cbb36-d62c-40ce-9e79-61f04e36627f is going to be deleted. [ 1038.534288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.534536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.555587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.555587] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54fe1b7a-483b-4522-ab83-ced21005a9ad is going to be deleted. [ 1038.555587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.555849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.575809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.575809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.577928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.577928] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3085df7e-1c09-4942-ba27-49d63274ac56 is going to be deleted. [ 1038.578793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.579018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.608821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.609237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8a63f06-9975-49cd-b7a4-1fc94db58876 is going to be deleted. [ 1038.609979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.610239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.611645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.611755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.628948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.629099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.631596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.631729] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe90e39-abbd-4d07-9021-eedecd7a9539 is going to be deleted. [ 1038.632738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.632963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.672435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.672583] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af559c94-c3c8-4ec7-9d79-d7e3d84241ba is going to be deleted. [ 1038.673625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.673955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.679634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.679634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.718064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.718229] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8dbec4d-8461-4cc1-9978-3a0a69ea030c is going to be deleted. [ 1038.719224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.719477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.722047] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.722165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.803168] env[65427]: INFO networking_nsxv3.common.synchronization [req-e1997462-b316-4b1a-abcc-9d7e65aa08a0 req-a110f10c-68db-4372-acb7-a10bc8f3145c tempest-MultipleCreateTestJSON-1375830875 tempest-MultipleCreateTestJSON-1375830875-project-member] Enqueued Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1038.803881] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d with Priority: HIGHEST for action security_group_members [ 1038.804251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.804362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.863251] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.893194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.893662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.893845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.894250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.894623] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.896022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.896022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.896022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.896519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.896659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.896878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.897148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.897447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.897673] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.899599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.900807] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd is going to be deleted. [ 1038.904751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.904751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.913098] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.913098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.913211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.913661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.913661] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.913819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.913819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.913971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.914178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.914178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.914311] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.914378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.914966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.914966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.914966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.914966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.914966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.914966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.915471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.915471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.915471] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.921789] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.921916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.930279] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.930464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.930622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.930751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.934103] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.950847] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.958127] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 1038.966710] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.966933] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.983105] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: SUCCESS [ 1038.983745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.983934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.984585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.986476] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.986476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.986476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.986476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.986476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.986476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.986476] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.988204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.988204] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4990f2fc-b7cf-4fec-8da8-647b0eb8509c is going to be deleted. [ 1038.988834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.989365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.014441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.014626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.023973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.024720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.056743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.056949] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be deleted. [ 1039.058485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.058844] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.136579] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.136794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.173374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.173546] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef110958-8d53-4daf-a376-677eb87ffe7f is going to be deleted. [ 1039.174518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.174745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.259578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.259885] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75cceb8-4b60-4a51-8efb-b3b64b024d41 is going to be deleted. [ 1039.261143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.261508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.265641] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.265861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.296162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.296387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.336312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.336547] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa68a58d-6f8b-44f5-b4ba-09baa1302d0a is going to be deleted. [ 1039.337621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.337621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.337831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.337882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-876f3d94-1c89-4fc5-91b9-bdd8347c716a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.338186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.338831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.338831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.338831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc0cbb36-d62c-40ce-9e79-61f04e36627f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.339207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.339307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.339455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.339517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54fe1b7a-483b-4522-ab83-ced21005a9ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.339795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.339795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.339921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.339961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3085df7e-1c09-4942-ba27-49d63274ac56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.340113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.340260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.340340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.340578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8a63f06-9975-49cd-b7a4-1fc94db58876" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.340578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.340727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe90e39-abbd-4d07-9021-eedecd7a9539" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af559c94-c3c8-4ec7-9d79-d7e3d84241ba" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.341525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.343272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.364056] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.405063] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b2d765d-91fb-4fe9-b7d0-06af18babd59: rpc.has_security_group_logging(os_id): False [ 1039.421811] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07e38e11-5e71-4d2b-b175-0954d843dabf: rpc.has_security_group_logging(os_id): False [ 1039.436254] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 1039.441373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.441743] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.441743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.442470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.442470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.442470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.442616] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.442679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.442738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.442893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.442990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.443432] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.443549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.443549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.443707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.443835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.443893] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1039.445195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.445442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.445555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.445693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8dbec4d-8461-4cc1-9978-3a0a69ea030c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.446478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.446843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.447581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.447581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c06f43-36b3-4d38-aa2b-a76ba03f6ebd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.448398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.448736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.448736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.450321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.451037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.451037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.453396] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546f1ff4-ef91-4671-86b3-d15ea6055715: rpc.has_security_group_logging(os_id): False [ 1039.491819] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.492178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.492178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.492533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.492892] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.493057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.493166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.493314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.493498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.493498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.493900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.494212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.494212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.494620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.495022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.496398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.496398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.496591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.496591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.497144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.497336] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.512138] env[65427]: INFO networking_nsxv3.common.synchronization [req-bf5317e6-4fa1-4e82-a83c-d8a90fefa95d req-54c88949-79cd-4a22-9768-3a7802778bf1 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1039.516212] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1039.516808] env[65427]: INFO networking_nsxv3.common.synchronization [req-ddf996ef-a393-4e42-8a31-c7499bad66d3 req-cf981c9f-ce2e-4483-8348-ee3221a855c8 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1039.517977] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.518151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.518228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.518507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.518744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.518831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.518874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.519573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.519714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.519827] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.521010] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1039.522570] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.522713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.522789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523483] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.523605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.523668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.524068] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.526464] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.526594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.527498] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.527604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.532607] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.532754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.534888] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.535085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.541530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.541860] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.541993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.542100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.542299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.542384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.542617] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.542750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.542846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.543132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.544849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.544849] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.544849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.544849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.544849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.544849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.544849] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 is going to be updated. [ 1039.545660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.545802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.545883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.546103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef110958-8d53-4daf-a376-677eb87ffe7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.546293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.546733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.546957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.547058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4990f2fc-b7cf-4fec-8da8-647b0eb8509c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.549306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.549454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.549550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.549682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.549835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.550030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.568703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.568703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.576442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1039.576928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.577097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.577264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.577353] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.609988] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: SUCCESS [ 1039.612497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.618250] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.618604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.618604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.618682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.619087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.619611] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.619611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.619611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.619805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.619880] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1039.621342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.621342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.682948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.682948] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.682948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.683659] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.683659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.683659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.683659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.683659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.683659] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 1039.684972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.689040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.689189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.689364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75cceb8-4b60-4a51-8efb-b3b64b024d41" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.689632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.689703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.689789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.690014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa68a58d-6f8b-44f5-b4ba-09baa1302d0a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.690531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.690697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.733560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.733969] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.734153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.734255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.734464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.734577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.734687] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1039.743838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.744099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.744099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.744284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.744437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.762585] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1039.793636] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.793879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.793924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.794251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.794319] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.803385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.803576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.803702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.803868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.804028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.816720] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: IN_PROGRESS for 2s [ 1039.820285] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1039.848928] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.848928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.848928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.848928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.848928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.867239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.868546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.868546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.868546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.868546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.868884] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be updated. [ 1039.897732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.897732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.897732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.897732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.897732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.915285] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1039.926767] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 1039.992715] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.992715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.992715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.992715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.992715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.003084] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5: rpc.has_security_group_logging(os_id): False [ 1040.007304] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: IN_PROGRESS for 2s [ 1040.010927] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc in Status: SUCCESS [ 1040.010927] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 511ffa69-7259-47ba-91d1-ab46e4d80bcc deletion is rescheduled due to dependency. [ 1040.010927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-511ffa69-7259-47ba-91d1-ab46e4d80bcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.026042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.026042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.026042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.026380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.026380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.027124] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.027124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.027124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.028036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.028036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.028036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.028434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.028744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.028854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.029081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.029267] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.029431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.029531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.030060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.030060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.030060] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 is going to be created. [ 1040.031428] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.031584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.031698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.031902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.032998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.033170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.044511] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.044712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.045538] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.045974] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.046472] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.046744] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.047151] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.047705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.047705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.050819] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.050819] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.050819] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.050819] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.050819] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.050819] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.050819] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.068734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.068734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.068734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.068734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.068734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.069089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.069089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.072513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.072513] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd already deleted. [ 1040.072513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.078891] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.078891] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.078891] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.078891] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.078891] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-2a02a026-8481-4ba3-9dae-b1de6920f12f taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.079271] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.079667] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.080032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.080142] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a02a026-8481-4ba3-9dae-b1de6920f12f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.105687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.105687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.105897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.105941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.106094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.107910] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.108067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.108115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.108372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.108463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.108557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be deleted. [ 1040.118602] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 1040.125771] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.125925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.125971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.126195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.126445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.136284] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: IN_PROGRESS for 2s [ 1040.207270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.207517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.207625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.207943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.208107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.208297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.585301] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.585734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.585734] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.586048] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.586282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.586381] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 2a02a026-8481-4ba3-9dae-b1de6920f12f not found, creating... [ 1040.586754] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.587062] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.587125] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.587412] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.587584] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.587911] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.588328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.588328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.588489] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.588630] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.588771] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 2a02a026-8481-4ba3-9dae-b1de6920f12f is going to be created. [ 1040.611345] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.611591] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.611678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.612354] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.612582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.612782] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.333463] env[65427]: INFO networking_nsxv3.common.synchronization [req-ddf996ef-a393-4e42-8a31-c7499bad66d3 req-6c6597bb-545b-46e9-8314-357560e2a865 service nova] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1041.333671] env[65427]: INFO networking_nsxv3.common.synchronization [req-ddf996ef-a393-4e42-8a31-c7499bad66d3 req-6c6597bb-545b-46e9-8314-357560e2a865 service nova] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1041.333810] env[65427]: INFO networking_nsxv3.common.synchronization [req-ddf996ef-a393-4e42-8a31-c7499bad66d3 req-6c6597bb-545b-46e9-8314-357560e2a865 service nova] Enqueued Resource ID: 2a02a026-8481-4ba3-9dae-b1de6920f12f with Priority: HIGHEST for action port [ 1041.339543] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_rules [ 1041.339543] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1041.339543] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a02a026-8481-4ba3-9dae-b1de6920f12f with Priority: HIGHEST for action port [ 1041.339543] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.339543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.339543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.339543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.339543] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.340038] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.340155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.340215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.340405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.340556] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.340654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.340718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.341128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.341128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.341882] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a02a026-8481-4ba3-9dae-b1de6920f12f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.341985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.342069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.342220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.342298] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a02a026-8481-4ba3-9dae-b1de6920f12f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.778417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1041.778417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.830129] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: SUCCESS [ 1041.830129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.842145] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1041.842145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.843787] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.847320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.847320] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a02a026-8481-4ba3-9dae-b1de6920f12f with status ACTIVE [ 1041.847320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.847320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.847320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.853207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.853207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.853207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.853207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.853207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.853207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a02a026-8481-4ba3-9dae-b1de6920f12f is going to be updated. [ 1041.882046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.882297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.882360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.882589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.882741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.883093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a02a026-8481-4ba3-9dae-b1de6920f12f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.936217] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1041.936217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.964577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 1041.964814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.019163] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d in Status: SUCCESS [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.021631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.021631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.021631] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd70ac25-12dc-445f-bc13-c1a6930fbf5d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.129934] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 1042.130707] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 1042.130707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.155645] env[65427]: INFO networking_nsxv3.common.synchronization [req-f82e2b42-b875-427f-bfa6-8b74560b298f req-ca6f9447-1c4b-448a-b063-4895625696e2 tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1042.155645] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: SUCCESS [ 1042.155645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.159473] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1042.159473] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.159473] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.159473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.159473] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.354029] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.523994] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.524221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.524356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.524595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.524595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.524810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.524910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.524974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.525159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.525240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.525484] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd70ac25-12dc-445f-bc13-c1a6930fbf5d is going to be deleted. [ 1042.605533] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.605533] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.605920] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.606232] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.606558] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.606769] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.606956] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.607294] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.607482] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.607751] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.607912] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.608075] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.608222] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.608399] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.608967] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.608967] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.618465] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.618785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.618785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.619226] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.619521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.619521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd70ac25-12dc-445f-bc13-c1a6930fbf5d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.647673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.647673] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.647673] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.647673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-361" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.648544] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-d9b56415-b899-44c7-b796-05c243e351e4 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.648874] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.648874] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.649234] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.649405] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b56415-b899-44c7-b796-05c243e351e4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.653937] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ad84a0d3-e354-4ec8-bf46-f44f45085b47 None None] Enqueued Resource ID: c8183dc6-ac62-4ccb-a860-af9efb0f12d6 with Priority: HIGHEST for action port [ 1042.654554] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8183dc6-ac62-4ccb-a860-af9efb0f12d6 with Priority: HIGHEST for action port [ 1042.654931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8183dc6-ac62-4ccb-a860-af9efb0f12d6 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.655130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8183dc6-ac62-4ccb-a860-af9efb0f12d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.655232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8183dc6-ac62-4ccb-a860-af9efb0f12d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.655509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8183dc6-ac62-4ccb-a860-af9efb0f12d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.655607] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8183dc6-ac62-4ccb-a860-af9efb0f12d6',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.664729] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.664729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.664729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.665095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.665250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.665583] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.665763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.665763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.665920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.665997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.666149] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb already deleted. [ 1042.666208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.856325] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.856726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.856726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.856726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.856726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.856858] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd is going to be created. [ 1042.889615] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.889800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.889878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.890124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.890325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.905457] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: UNINITIALIZED for 2s [ 1043.151985] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.152240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.152371] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.152665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.152909] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.153137] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port d9b56415-b899-44c7-b796-05c243e351e4 not found, creating... [ 1043.153508] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.153621] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.153741] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.153981] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.154138] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.154432] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.154588] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.154708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.155053] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.155205] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.155350] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: d9b56415-b899-44c7-b796-05c243e351e4 is going to be created. [ 1043.157224] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8183dc6-ac62-4ccb-a860-af9efb0f12d6 [ 1043.157483] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.157607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.157693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.157869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.158139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.158139] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8183dc6-ac62-4ccb-a860-af9efb0f12d6 already deleted. [ 1043.158265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8183dc6-ac62-4ccb-a860-af9efb0f12d6" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.178792] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.179019] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.179159] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.179443] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.179706] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.180213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.921082] env[65427]: INFO networking_nsxv3.common.synchronization [req-f82e2b42-b875-427f-bfa6-8b74560b298f req-8c50f3ee-cf59-4f77-bb46-19483b7a34d7 service nova] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1043.923872] env[65427]: INFO networking_nsxv3.common.synchronization [req-f82e2b42-b875-427f-bfa6-8b74560b298f req-8c50f3ee-cf59-4f77-bb46-19483b7a34d7 service nova] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1043.924142] env[65427]: INFO networking_nsxv3.common.synchronization [req-f82e2b42-b875-427f-bfa6-8b74560b298f req-8c50f3ee-cf59-4f77-bb46-19483b7a34d7 service nova] Enqueued Resource ID: d9b56415-b899-44c7-b796-05c243e351e4 with Priority: HIGHEST for action port [ 1043.928427] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_rules [ 1043.928544] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1043.928650] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b56415-b899-44c7-b796-05c243e351e4 with Priority: HIGHEST for action port [ 1043.929710] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.929828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.929881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.930070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.930163] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.933298] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.933438] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.933513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.935767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.935956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.936037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.936088] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.936259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.936445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.936445] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.937433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9b56415-b899-44c7-b796-05c243e351e4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.937550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.937641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.937808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.937918] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b56415-b899-44c7-b796-05c243e351e4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.440604] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.440794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.441008] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9b56415-b899-44c7-b796-05c243e351e4 with status ACTIVE [ 1044.441232] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.441351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.441477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.442036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.442036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442331] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.442331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.442331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.442529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.442613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442804] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.442900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.442963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.443192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.443308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.443355] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9b56415-b899-44c7-b796-05c243e351e4 is going to be updated. [ 1044.444804] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.472620] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.472809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.472866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.473515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.473515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.473515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9b56415-b899-44c7-b796-05c243e351e4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.923043] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: SUCCESS [ 1044.923507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.923507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.924509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.924509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.924509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.924509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.924509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.924509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.924822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.924945] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.947761] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.205631] env[65427]: INFO networking_nsxv3.common.synchronization [req-63c33097-7e19-41a9-843f-74f85a2d28a9 req-3eb3b1be-a4c5-4793-b47b-20fdd70aeadf tempest-SecurityGroupRulesNegativeTestJSON-1207053966 tempest-SecurityGroupRulesNegativeTestJSON-1207053966-project-member] Enqueued Resource ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 with Priority: HIGHEST for action security_group_rules [ 1045.207215] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 with Priority: HIGHEST for action security_group_rules [ 1045.207215] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.207215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.207215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.207215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.207499] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ec0d90-933a-4b41-a520-1ae4a7e51696',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.428195] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.451942] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.451942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.451942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.451942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.451942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.451942] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb is going to be created. [ 1045.478433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.478433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.478433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.478433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.478433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.490026] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: UNINITIALIZED for 2s [ 1045.727163] env[65427]: INFO networking_nsxv3.common.synchronization [None req-6c280cdd-a0b8-4cf7-91d1-4596df639a13 None None] Enqueued Resource ID: eda9fcf1-6545-4b9b-9a03-67d13e38ce45 with Priority: HIGHEST for action port [ 1045.728352] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda9fcf1-6545-4b9b-9a03-67d13e38ce45 with Priority: HIGHEST for action port [ 1045.728352] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-eda9fcf1-6545-4b9b-9a03-67d13e38ce45 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.728352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eda9fcf1-6545-4b9b-9a03-67d13e38ce45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.728352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eda9fcf1-6545-4b9b-9a03-67d13e38ce45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.728757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eda9fcf1-6545-4b9b-9a03-67d13e38ce45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.728757] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eda9fcf1-6545-4b9b-9a03-67d13e38ce45',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.736454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.736603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.736659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.737072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.737072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.737072] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 already deleted. [ 1045.737238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.931416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a54a063-1f93-4072-9d9d-c355160cc6fd: rpc.has_security_group_logging(os_id): False [ 1045.960345] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.960345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.960665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.960665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.960770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.961018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.961147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.961147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.961320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.961411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.961479] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd is going to be created. [ 1046.065753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.066133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.066133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.066451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.066777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.081033] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: IN_PROGRESS for 2s [ 1046.232662] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eda9fcf1-6545-4b9b-9a03-67d13e38ce45 [ 1046.233583] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.233583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.233583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.233583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.233583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.234700] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eda9fcf1-6545-4b9b-9a03-67d13e38ce45 already deleted. [ 1046.234700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eda9fcf1-6545-4b9b-9a03-67d13e38ce45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.366115] env[65427]: INFO networking_nsxv3.common.synchronization [req-9bb98a17-30d9-43e6-a3ac-1110f7086138 req-27ee9c78-8f1a-4a20-b61e-2f0dcf93810a tempest-SecurityGroupRulesNegativeTestJSON-1207053966 tempest-SecurityGroupRulesNegativeTestJSON-1207053966-project-member] Enqueued Resource ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 with Priority: HIGHEST for action security_group_rules [ 1046.366682] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 with Priority: HIGHEST for action security_group_rules [ 1046.367169] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.367256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.367532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.367655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.367858] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ec0d90-933a-4b41-a520-1ae4a7e51696',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.897786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.897954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.898045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.898327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.898410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.898515] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ec0d90-933a-4b41-a520-1ae4a7e51696 already deleted. [ 1046.898594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ec0d90-933a-4b41-a520-1ae4a7e51696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.398300] env[65427]: INFO networking_nsxv3.common.synchronization [req-0554d0da-9920-42ad-8597-aa23f8839273 req-3e48f20c-c480-4bae-867d-8094542ed63e tempest-InstanceActionsV221TestJSON-1132591777 tempest-InstanceActionsV221TestJSON-1132591777-project-member] Enqueued Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1047.398300] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGHEST for action security_group_members [ 1047.401079] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.401245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.401285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.401607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.401851] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.401851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.401851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.401983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.402075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.402114] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.500493] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: SUCCESS [ 1047.500727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.501898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.501898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.501898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.501898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.501898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.501898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.502249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.502832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.503255] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.905331] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.905331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.905331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.905331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.905331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.905331] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.905809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.905809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.905809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.905809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.906094] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 is going to be updated. [ 1047.943667] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.943801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.943894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.944100] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.944237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.955631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: IN_PROGRESS for 2s [ 1048.006199] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.098307] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: SUCCESS [ 1048.098736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.510149] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3403f3a9-6000-4b2c-afd8-65a85129fffb: rpc.has_security_group_logging(os_id): False [ 1048.528855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.529095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.529095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.529329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.529441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.529708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.529836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.529903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.530094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.530170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.530260] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb is going to be created. [ 1048.589906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.590104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.590104] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.590329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.590552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.602669] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: IN_PROGRESS for 2s [ 1049.768175] env[65427]: INFO networking_nsxv3.common.synchronization [req-de682526-b5e6-44c6-a88c-7ed086f949f1 req-4f131fac-aefd-4e35-89e1-1c0cf2d25aab tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1049.768538] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1049.768607] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.768711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.768778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.768973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.769282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.769396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.769498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.769684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.769795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.769910] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.968699] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 in Status: SUCCESS [ 1049.969648] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 deletion is rescheduled due to dependency. [ 1049.969648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.182638] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.188139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.188470] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.188804] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.189186] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.189371] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.189495] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.189725] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.189868] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.190115] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.190316] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.190552] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.190701] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.190832] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.190963] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.191282] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.217077] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.217077] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.217320] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.217484] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-851" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.217938] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-e1d9688c-dfd7-4d83-addb-8004b591e1d7 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.218228] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.218414] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.218799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.218989] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d9688c-dfd7-4d83-addb-8004b591e1d7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.272490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.272490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.272490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.272769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.272961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.273227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.273341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.273394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.273587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.274014] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.274014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 1050.305225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.305509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.305509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.305756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.305921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.316286] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 1050.561058] env[65427]: INFO networking_nsxv3.common.synchronization [req-697bae90-b492-4061-8ef1-4948ab2789b6 req-c9615e57-afee-49f7-9e8d-c52e6e226257 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1050.561618] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1050.561967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.562103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.562175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.562369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.562529] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.562627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.562696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.562893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.562985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.563093] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.624820] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: SUCCESS [ 1050.625044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.721351] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.723181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.723181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.723181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.723181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.723181] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port e1d9688c-dfd7-4d83-addb-8004b591e1d7 not found, creating... [ 1050.723181] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.723604] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.723921] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.724362] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.724660] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.725881] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.725881] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.725881] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.727964] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.727964] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.727964] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: e1d9688c-dfd7-4d83-addb-8004b591e1d7 is going to be created. [ 1050.750410] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.750410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.750410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.750410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.750410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.750410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.887813] env[65427]: INFO networking_nsxv3.common.synchronization [req-f3bd59fb-5934-43ca-aeec-f567efd5d8db req-e0ed9295-fffb-467a-9df8-7b43b9d9a979 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1050.888724] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1050.889099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.889236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.889306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.889522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.889824] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.889824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.890119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.890119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.890119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.890218] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.065053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.065221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.065296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.065636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.065760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.065977] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.066099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.066165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.066320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.066436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.066546] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1051.100176] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.100338] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.100404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.100607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.100751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.112115] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1051.370115] env[65427]: INFO networking_nsxv3.common.synchronization [None req-f15b69b7-739d-40c6-90da-6706dd967a7d tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1051.370702] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1051.371059] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.371177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.371235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.371474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.371620] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.393207] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.499942] env[65427]: INFO networking_nsxv3.common.synchronization [None req-88b13e77-b945-4499-8d3e-e699c2ab41b4 tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1051.500295] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1051.500679] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.500801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.508419] env[65427]: INFO networking_nsxv3.common.synchronization [req-de682526-b5e6-44c6-a88c-7ed086f949f1 req-270411ec-7f24-4e0f-8c88-d4f2f77d92aa service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 1051.508679] env[65427]: INFO networking_nsxv3.common.synchronization [req-de682526-b5e6-44c6-a88c-7ed086f949f1 req-270411ec-7f24-4e0f-8c88-d4f2f77d92aa service nova] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1051.508837] env[65427]: INFO networking_nsxv3.common.synchronization [req-de682526-b5e6-44c6-a88c-7ed086f949f1 req-270411ec-7f24-4e0f-8c88-d4f2f77d92aa service nova] Enqueued Resource ID: e1d9688c-dfd7-4d83-addb-8004b591e1d7 with Priority: HIGHEST for action port [ 1051.509559] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_rules [ 1051.509700] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1051.509799] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1d9688c-dfd7-4d83-addb-8004b591e1d7 with Priority: HIGHEST for action port [ 1051.510466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.510614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.510680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.510910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.510998] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.514029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.514152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.514347] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1d9688c-dfd7-4d83-addb-8004b591e1d7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.514441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.514511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.515190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.515190] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d9688c-dfd7-4d83-addb-8004b591e1d7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.893640] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.893640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.893640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.894406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.894406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.894406] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c already deleted. [ 1051.894406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.894406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.894406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.894406] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.895292] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.017536] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.017723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.017981] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1d9688c-dfd7-4d83-addb-8004b591e1d7 with status ACTIVE [ 1052.018194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.018308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.018375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.018611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.018713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.018892] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.018991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.019064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.019237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.019347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.019520] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.019653] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.019721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.019829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.019904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.020017] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1d9688c-dfd7-4d83-addb-8004b591e1d7 is going to be updated. [ 1052.047230] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.047574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.047574] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.047714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.047890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.048116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1d9688c-dfd7-4d83-addb-8004b591e1d7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.327409] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 1052.327812] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 1052.327812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.328164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.328395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.328754] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.328754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.328885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.329041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.329147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.329305] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.399531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.399796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.399889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.400126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.400225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.400340] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1052.420387] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.420550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.420668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.420876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.420981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.421105] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c already deleted. [ 1052.421196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.435117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.435117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.435117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.435117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.435117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.447741] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1052.705081] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.705304] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.705490] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.705785] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.706599] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.706821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.706947] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.707299] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.707473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.707701] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.708151] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.708496] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.708496] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.708709] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.710086] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.710086] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.730771] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.730964] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.731134] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.731327] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-437" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.731936] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-158517b8-96e5-4777-979d-e589128cc5c7 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.732107] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.732267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.732662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.732804] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158517b8-96e5-4777-979d-e589128cc5c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.832607] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.122693] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1053.122972] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1053.122972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.235505] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.235713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.235912] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.236177] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.236335] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.236741] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.236877] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.236983] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.237231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.237315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.237613] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.237763] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.237876] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.238241] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.238398] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.238544] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 158517b8-96e5-4777-979d-e589128cc5c7 is going to be updated. [ 1053.272909] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.273166] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.273576] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.273892] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.274131] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.274403] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.335203] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.839931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.839931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.839931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.839931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.839931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.839931] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 1053.877482] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.877482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.877482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.877482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.877482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.884647] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 1054.000152] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9df684e-9b31-4f9a-a19b-41ef877c4a71 req-0c325253-8b91-46d9-a5f4-c13b264f4eed service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 1054.000359] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9df684e-9b31-4f9a-a19b-41ef877c4a71 req-0c325253-8b91-46d9-a5f4-c13b264f4eed service nova] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 1054.000583] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9df684e-9b31-4f9a-a19b-41ef877c4a71 req-0c325253-8b91-46d9-a5f4-c13b264f4eed service nova] Enqueued Resource ID: 158517b8-96e5-4777-979d-e589128cc5c7 with Priority: HIGHEST for action port [ 1054.001063] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_rules [ 1054.001203] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 1054.001300] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158517b8-96e5-4777-979d-e589128cc5c7 with Priority: HIGHEST for action port [ 1054.002097] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.002097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.002097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.002097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.002097] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.002936] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.003058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.003120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.003299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.003480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.003581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.004153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.004153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.004153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.004153] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.005642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-158517b8-96e5-4777-979d-e589128cc5c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.005642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.005642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.005642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.005642] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158517b8-96e5-4777-979d-e589128cc5c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.408407] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c8ff651c-6de8-46d9-8574-d2b074eb88cd None None] Enqueued Resource ID: a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a with Priority: HIGHEST for action port [ 1054.408993] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a with Priority: HIGHEST for action port [ 1054.409594] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.409736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.409806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.410102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.410188] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.457837] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1054.458016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.507069] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.507312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.507493] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.508421] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 158517b8-96e5-4777-979d-e589128cc5c7 with status ACTIVE [ 1054.508634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.508753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.508876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.509061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.509154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.510407] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.510407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.510407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.510407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.513848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.513848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.513848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.513848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.513848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.513848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.513848] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 158517b8-96e5-4777-979d-e589128cc5c7 is going to be updated. [ 1054.536874] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.536874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.536874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.537123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.537123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.537303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-158517b8-96e5-4777-979d-e589128cc5c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.912399] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a [ 1054.912653] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.912768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.912842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.913075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.913168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.913267] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a already deleted. [ 1054.913350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1c90316-ff6a-4ecd-a85b-cbe1f506ba7a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.013737] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.518510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.518828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.518828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.518999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.519086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.519157] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 1055.570708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.570888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.570961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.571199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.571354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.584577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 1055.896573] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 1055.897025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.897205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.900076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.900076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.900076] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.401647] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.401896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.401896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.402645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.402645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.402645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.402645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.402645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.402934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.402934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.402934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.403124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.403124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.403260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.403687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.403687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.403687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.403687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.403978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.403978] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.403978] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.905980] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7abbe624-4b85-4277-bdd0-ed749e166fc9: rpc.has_security_group_logging(os_id): False [ 1056.926220] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.926398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.926463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.926650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.926736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.927103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.927103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.927245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.927283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.927348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.927527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.927621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.927687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.927918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.927972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.930194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.930622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.930622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.932360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.932360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.932360] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 1056.998739] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.998953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.998953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.999161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.999298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.014760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 1057.430521] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-53 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.432282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.432511] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.432816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.435127] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.435323] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.435502] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.435732] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.435882] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.436110] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.436234] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.436347] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.436460] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.436817] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.436817] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.436817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.458808] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.458808] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.458808] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.459098] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-53" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.459397] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-bc12d155-fcc3-492c-a8b6-ce364f2a6869 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.459572] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.459739] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.459945] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.460089] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12d155-fcc3-492c-a8b6-ce364f2a6869',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.596840] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 1057.597092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.597288] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.597547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.597776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.597925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.597992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.598286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.598286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.598364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.598439] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.902156] env[65427]: INFO networking_nsxv3.common.synchronization [None req-7980e492-dd07-4ec5-9037-741c3e5ad5ef None None] Enqueued Resource ID: a47f5b04-3bf1-4857-a761-617153a7bf46 with Priority: HIGHEST for action port [ 1057.902424] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47f5b04-3bf1-4857-a761-617153a7bf46 with Priority: HIGHEST for action port [ 1057.902975] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a47f5b04-3bf1-4857-a761-617153a7bf46 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.903367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a47f5b04-3bf1-4857-a761-617153a7bf46" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.903466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a47f5b04-3bf1-4857-a761-617153a7bf46" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.903739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a47f5b04-3bf1-4857-a761-617153a7bf46" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.903835] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a47f5b04-3bf1-4857-a761-617153a7bf46',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.962463] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.962997] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.962997] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.963169] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.963242] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.963534] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.963685] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.963807] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.964033] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.964175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.964455] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.964610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.964727] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.964929] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.965075] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.965244] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 is going to be updated. [ 1057.988361] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.990634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.990634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.990634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.990634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.990883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.107949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.107949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.107949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.107949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.107949] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.406944] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a47f5b04-3bf1-4857-a761-617153a7bf46 [ 1058.407127] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.407230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.407293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.408079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.408079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.408079] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a47f5b04-3bf1-4857-a761-617153a7bf46 already deleted. [ 1058.408079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a47f5b04-3bf1-4857-a761-617153a7bf46" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.609796] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b945fd5-1333-4892-be63-1784a8a66349: rpc.has_security_group_logging(os_id): False [ 1058.628733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.628906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.629024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.629554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.652990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.653270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.653407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.653513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.653730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.653880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.654067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.654174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.654229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.654385] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.654462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.654645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.654740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.654801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.654949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.656369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.656369] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 1058.726193] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.726383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.726434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.729023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.729023] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.732800] env[65427]: INFO networking_nsxv3.common.synchronization [req-04408e74-fb7a-4918-98bc-845abc5f2fa0 req-6df4baba-fdd5-4653-b504-3d2e553945b6 service nova] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 1058.732991] env[65427]: INFO networking_nsxv3.common.synchronization [req-04408e74-fb7a-4918-98bc-845abc5f2fa0 req-6df4baba-fdd5-4653-b504-3d2e553945b6 service nova] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 1058.733290] env[65427]: INFO networking_nsxv3.common.synchronization [req-04408e74-fb7a-4918-98bc-845abc5f2fa0 req-6df4baba-fdd5-4653-b504-3d2e553945b6 service nova] Enqueued Resource ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 with Priority: HIGHEST for action port [ 1058.733765] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_rules [ 1058.733897] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 1058.733994] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 with Priority: HIGHEST for action port [ 1058.738318] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.738318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.738318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.738318] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.738318] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.739934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.739934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.739934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.739934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.740238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.740238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.740386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.740462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.740545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.740647] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.742342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc12d155-fcc3-492c-a8b6-ce364f2a6869 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.742533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.742662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.742945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.743359] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc12d155-fcc3-492c-a8b6-ce364f2a6869',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.752387] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 1059.030208] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 1059.030545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.246126] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.246353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.250629] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.252134] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc12d155-fcc3-492c-a8b6-ce364f2a6869 with status ACTIVE [ 1059.253296] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.253296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.253296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.253296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.253296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.253741] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.253741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.253841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.257575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.257575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.257886] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.258694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.258694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.258694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.258694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.258694] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc12d155-fcc3-492c-a8b6-ce364f2a6869 is going to be updated. [ 1059.295220] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.295370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.295370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.296089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.296089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.296089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc12d155-fcc3-492c-a8b6-ce364f2a6869" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.761298] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.798855] env[65427]: INFO networking_nsxv3.common.synchronization [req-7f1a2387-b78f-4cd7-a54e-2b7497334853 req-7ccedfab-3e80-40d2-aa99-27f09b71d5bb tempest-ImagesOneServerTestJSON-2057403856 tempest-ImagesOneServerTestJSON-2057403856-project-member] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 1059.802210] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGHEST for action security_group_members [ 1059.802210] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.802393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.802393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.802715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.802899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.803049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.803181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.803353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.803462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.803802] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.266067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.266067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.266067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.266067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.266548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.266548] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be updated. [ 1060.304773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.304950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.305037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.305221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.305356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.308063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.308203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.308252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.308434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.308521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.308707] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.308808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.308872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.309035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.309112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.309199] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 is going to be updated. [ 1060.320616] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: IN_PROGRESS for 2s [ 1060.341940] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.342180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.342271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.342794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.342794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.353207] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: IN_PROGRESS for 2s [ 1060.778626] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 1060.778875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.206189] env[65427]: INFO networking_nsxv3.common.synchronization [req-69960881-8660-4d16-9ca7-95fcd238837e req-add12bd5-575b-4bac-bc55-1ca04574173a tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1062.206978] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1062.207380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.207528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.207600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.207885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.208072] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.208180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.208245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.208404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.208488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.208585] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.330869] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: SUCCESS [ 1062.331195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.331380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.331603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.331958] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.332105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.332160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.332334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.332453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.332514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.332683] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.362588] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 in Status: SUCCESS [ 1062.362774] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 deletion is rescheduled due to dependency. [ 1062.362826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.597042] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.597042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.597042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.597042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.597402] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.597473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.597540] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.600883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.600883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.600883] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.600883] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.600883] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.600883] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.600883] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.600883] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.600883] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.619620] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.619775] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.619905] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.620109] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-135" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.620435] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.620825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.620825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.621144] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.621287] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4dbcffb-57d2-4b5d-87f5-d76bb023623a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.711581] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.711776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.711849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.712064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.712216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.712436] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.712536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.713161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.713161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.713161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.713161] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c already deleted. [ 1062.713161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.835256] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.124833] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.125164] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.125340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.125895] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.126175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.126362] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port c4dbcffb-57d2-4b5d-87f5-d76bb023623a not found, creating... [ 1063.126776] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.127068] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.127296] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.127583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.127799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.128254] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.128463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.128585] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.129731] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.129731] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.129731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: c4dbcffb-57d2-4b5d-87f5-d76bb023623a is going to be created. [ 1063.150286] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.150589] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.150657] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.151019] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.151298] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.151590] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.338268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c3613c9-fe90-4521-87ed-64503d04b3d5: rpc.has_security_group_logging(os_id): False [ 1063.362124] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.362124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.362124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.362434] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.390606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.391344] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.391344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.391344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.391597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.391597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.391695] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be updated. [ 1063.463547] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.463696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.463739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.464193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.464400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.479696] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: IN_PROGRESS for 2s [ 1063.902077] env[65427]: INFO networking_nsxv3.common.synchronization [req-69960881-8660-4d16-9ca7-95fcd238837e req-91a4fa2a-c44c-4845-90db-9881294e24d8 service nova] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1063.902399] env[65427]: INFO networking_nsxv3.common.synchronization [req-69960881-8660-4d16-9ca7-95fcd238837e req-91a4fa2a-c44c-4845-90db-9881294e24d8 service nova] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1063.902688] env[65427]: INFO networking_nsxv3.common.synchronization [req-69960881-8660-4d16-9ca7-95fcd238837e req-91a4fa2a-c44c-4845-90db-9881294e24d8 service nova] Enqueued Resource ID: c4dbcffb-57d2-4b5d-87f5-d76bb023623a with Priority: HIGHEST for action port [ 1063.905727] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_rules [ 1063.906038] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1063.906224] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4dbcffb-57d2-4b5d-87f5-d76bb023623a with Priority: HIGHEST for action port [ 1063.906766] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.906905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.906905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.907308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.907459] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.908871] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.909066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.909171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.909441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.910329] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.910329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.910329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.910329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.910329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.910856] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.911798] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.912019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.912133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.912202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.912272] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4dbcffb-57d2-4b5d-87f5-d76bb023623a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.413883] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.415333] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.415566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.415831] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4dbcffb-57d2-4b5d-87f5-d76bb023623a with status ACTIVE [ 1064.416108] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.416287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.416406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.416702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.416850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.417625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.418107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.418107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.418383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.418554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.419117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.419117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.419117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.419273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.419420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.419607] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4dbcffb-57d2-4b5d-87f5-d76bb023623a is going to be updated. [ 1064.450063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.450491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.450491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.450645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.450719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.450846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4dbcffb-57d2-4b5d-87f5-d76bb023623a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.661834] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a037161-deea-40a5-b279-153ddf3c9be4 req-a195288f-2220-4a32-9018-2a541e822aa4 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1064.661834] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1064.661834] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.662121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.662121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.662384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.662620] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.662781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.662912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.663151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.663308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.663490] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.922266] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.003412] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.003658] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.003790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.004076] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.004349] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.004507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.004697] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.005474] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.005746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.006201] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.006395] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.006596] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.006817] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.007077] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.007327] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.007631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.030580] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.030861] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.031120] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.031485] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.031890] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-99a5b535-e60b-4ab3-804b-ba2fc94c868f taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.032227] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.032498] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.032879] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.033164] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99a5b535-e60b-4ab3-804b-ba2fc94c868f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.166652] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.166652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.166652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.166652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.166652] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.166955] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.167089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.167171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.167425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.167538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.167661] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1065.196286] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.196286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.196783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.196783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.196783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.207153] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1065.425041] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.425475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.425475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.425698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.425846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.426154] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c is going to be created. [ 1065.459135] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.459408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.459504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.459728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.459893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.472130] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: UNINITIALIZED for 2s [ 1065.494024] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: SUCCESS [ 1065.494258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.537964] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.538355] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.538521] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.538928] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.539156] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.539366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 99a5b535-e60b-4ab3-804b-ba2fc94c868f not found, creating... [ 1065.539761] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.540044] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.540256] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.540587] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.540812] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.541184] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.541421] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.541632] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.541938] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.542159] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.542362] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 99a5b535-e60b-4ab3-804b-ba2fc94c868f is going to be created. [ 1065.567380] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.567730] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.567998] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.568602] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.568886] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.569175] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.791651] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9c5936a-26ff-4634-aa0e-44d324a66b04 req-0058a2d4-8bfe-4ffc-a0d5-292cae5dbe62 tempest-ServerDiskConfigTestJSON-2007598164 tempest-ServerDiskConfigTestJSON-2007598164-project-member] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1065.792817] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGHEST for action security_group_members [ 1065.792817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.793029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.793029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.793247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.793455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.793648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.793717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.793889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.793971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.794085] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.296789] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.296789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.296789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.297127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.297197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.298094] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.298094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.298094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.298094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.298384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.298384] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be updated. [ 1066.354687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.354944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.355011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.355350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.355595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.365116] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a037161-deea-40a5-b279-153ddf3c9be4 req-56f18f1e-8f15-4cdf-a41f-cec317e80a4e service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1066.365420] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a037161-deea-40a5-b279-153ddf3c9be4 req-56f18f1e-8f15-4cdf-a41f-cec317e80a4e service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1066.365755] env[65427]: INFO networking_nsxv3.common.synchronization [req-5a037161-deea-40a5-b279-153ddf3c9be4 req-56f18f1e-8f15-4cdf-a41f-cec317e80a4e service nova] Enqueued Resource ID: 99a5b535-e60b-4ab3-804b-ba2fc94c868f with Priority: HIGHEST for action port [ 1066.367045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: IN_PROGRESS for 2s [ 1066.367714] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1066.367929] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1066.368092] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99a5b535-e60b-4ab3-804b-ba2fc94c868f with Priority: HIGHEST for action port [ 1066.368534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.368720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.368869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.369161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.369283] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.370667] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.370725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.371029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-99a5b535-e60b-4ab3-804b-ba2fc94c868f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.371200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.371277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.371563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.371675] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99a5b535-e60b-4ab3-804b-ba2fc94c868f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.874192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.874522] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.874552] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99a5b535-e60b-4ab3-804b-ba2fc94c868f with status ACTIVE [ 1066.874719] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.874823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.874935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.875198] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.875287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.875587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.875699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.875767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.875937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.876032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.876217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.876309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.876367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.876532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.876637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.876754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99a5b535-e60b-4ab3-804b-ba2fc94c868f is going to be updated. [ 1066.901378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.901554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.901832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.901832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.902031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.902274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99a5b535-e60b-4ab3-804b-ba2fc94c868f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.164362] env[65427]: INFO networking_nsxv3.common.synchronization [req-4684cf53-01f5-46f9-a473-46b26a7b45e9 req-f10b03b5-eb0f-44e0-b6a2-dba8a8da1482 tempest-InstanceActionsTestJSON-1995827160 tempest-InstanceActionsTestJSON-1995827160-project-member] Enqueued Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1067.164957] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1067.165295] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.165452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.165492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.165774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.165949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.167523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.167523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.167523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.167523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.167523] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.217902] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 4s [ 1067.484427] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: SUCCESS [ 1067.484679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.484854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.485152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.485325] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.485450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.485568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.485753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.485840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.485953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.486066] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.579701] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.579932] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-932" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.581402] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-932" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.582770] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-932" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.583142] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.583316] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.583975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.583975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.583975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.584325] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.584445] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.584557] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.584667] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.584779] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.584888] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.585063] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.613669] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.613871] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.614019] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.614218] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-932" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.614749] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-94ee419e-1a40-4b48-b79f-7edee203050d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.614887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.614887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.615264] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.615409] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ee419e-1a40-4b48-b79f-7edee203050d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.669115] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.669295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.669363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.669601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.669697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.669918] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.670034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.670117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.670245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.670323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.670411] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 already deleted. [ 1067.670542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.988544] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.118440] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.118678] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.118791] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.119104] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.119261] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.119417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 94ee419e-1a40-4b48-b79f-7edee203050d not found, creating... [ 1068.119721] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.119921] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.120094] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.120396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.120571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.120865] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.121099] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.121231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.121582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.121582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.121716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 94ee419e-1a40-4b48-b79f-7edee203050d is going to be created. [ 1068.143892] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.144181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.144340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.144626] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.144862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.145097] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.382758] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 in Status: SUCCESS [ 1068.383051] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 deletion is rescheduled due to dependency. [ 1068.383227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.490668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f6a6fc4-6042-426c-9f0e-146d4bed152c: rpc.has_security_group_logging(os_id): False [ 1068.512195] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.512195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.512195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.512581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.512581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.512780] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.512904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.512951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.513187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.513292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.513414] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c is going to be created. [ 1068.584339] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.584339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.584339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.584612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.584612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.597672] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: IN_PROGRESS for 2s [ 1068.877418] env[65427]: INFO networking_nsxv3.common.synchronization [req-4684cf53-01f5-46f9-a473-46b26a7b45e9 req-45e4e1c6-335c-4e03-96a1-39e0519cd2dc service nova] Enqueued Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_rules [ 1068.877609] env[65427]: INFO networking_nsxv3.common.synchronization [req-4684cf53-01f5-46f9-a473-46b26a7b45e9 req-45e4e1c6-335c-4e03-96a1-39e0519cd2dc service nova] Enqueued Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1068.877780] env[65427]: INFO networking_nsxv3.common.synchronization [req-4684cf53-01f5-46f9-a473-46b26a7b45e9 req-45e4e1c6-335c-4e03-96a1-39e0519cd2dc service nova] Enqueued Resource ID: 94ee419e-1a40-4b48-b79f-7edee203050d with Priority: HIGHEST for action port [ 1068.879145] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_rules [ 1068.879296] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1068.879440] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ee419e-1a40-4b48-b79f-7edee203050d with Priority: HIGHEST for action port [ 1068.879857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.879992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.880079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.880637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.880749] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.881764] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.881884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.881987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.882196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.882360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.882461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.882526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.882690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.882798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.882934] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.886286] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-94ee419e-1a40-4b48-b79f-7edee203050d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.886286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.886286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.886436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.886558] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ee419e-1a40-4b48-b79f-7edee203050d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.232606] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1069.233016] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1069.233016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.233247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.233542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.233777] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.233935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.234179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.234179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.234313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.234313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.388275] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.389611] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.390442] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.390670] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94ee419e-1a40-4b48-b79f-7edee203050d with status ACTIVE [ 1069.390900] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.391089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.391164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.391407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.391668] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.391808] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.391956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.392049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.392207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.392286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.392479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.392579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.392685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.392946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.392946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.393157] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94ee419e-1a40-4b48-b79f-7edee203050d is going to be updated. [ 1069.417692] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.417897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.418216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.418216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.418471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.418515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94ee419e-1a40-4b48-b79f-7edee203050d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.737478] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.896214] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.241699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.398571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.398861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.398919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.399250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.399320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.399424] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 is going to be created. [ 1070.430623] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.430769] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.430838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.431075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.431240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.445846] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: UNINITIALIZED for 2s [ 1070.612733] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: SUCCESS [ 1070.612981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.746578] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.746578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.746578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.746578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.746578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.746578] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1070.826280] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.826487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.826487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.826727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.826878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.841337] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1071.666399] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b838ff9-988d-4b9b-847a-d2bf991c8d1c req-8eb0ab3e-2f5f-407c-a236-765d7b3c30ab tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1071.667635] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1071.668903] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.669044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.669119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.669324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.669492] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.669597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.669664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.669815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.669900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.670122] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.013194] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.013477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.013624] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.014401] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.014401] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.014583] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.014746] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.015525] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.015921] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.016074] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.016211] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.016330] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.016441] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.016559] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.016663] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.016862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.039246] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.039426] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.039601] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.039865] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.040308] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-d4786e88-a231-4c80-a05d-fb642be867ad taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.040584] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.040786] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.041140] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.041312] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4786e88-a231-4c80-a05d-fb642be867ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.175473] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.459649] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: SUCCESS [ 1072.459904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.460220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.460444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.460658] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.460767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.460835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.462687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.462687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.462687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.462687] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.546016] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.546260] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.546390] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.546691] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.546866] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.547086] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port d4786e88-a231-4c80-a05d-fb642be867ad not found, creating... [ 1072.547488] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.547613] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.547775] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.548253] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.548450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.548858] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.549148] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.549311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.549641] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.549832] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.549971] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: d4786e88-a231-4c80-a05d-fb642be867ad is going to be created. [ 1072.583985] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.584235] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.584362] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.584669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.584964] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.585252] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.678789] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.852340] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1072.852730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.853050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.853390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.853819] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.853819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.853938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.854037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.854123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.854221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.854313] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.964809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.964968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.965049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.965279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.965453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.965561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.965637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.965789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.965872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.965960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.966123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.966211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.966269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.966404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.967938] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.967938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.967938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.967938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.967938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.967938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.967938] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.181345] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.181497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.181565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.181943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.182201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.182268] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1073.214876] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.215134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.215256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.215507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.216109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.226367] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1073.331021] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b838ff9-988d-4b9b-847a-d2bf991c8d1c req-1796b433-6ce9-4b7c-ab4c-883bddd2746d service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1073.331021] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b838ff9-988d-4b9b-847a-d2bf991c8d1c req-1796b433-6ce9-4b7c-ab4c-883bddd2746d service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1073.331021] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b838ff9-988d-4b9b-847a-d2bf991c8d1c req-1796b433-6ce9-4b7c-ab4c-883bddd2746d service nova] Enqueued Resource ID: d4786e88-a231-4c80-a05d-fb642be867ad with Priority: HIGHEST for action port [ 1073.333243] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1073.333243] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1073.333243] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4786e88-a231-4c80-a05d-fb642be867ad with Priority: HIGHEST for action port [ 1073.333645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.333645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.333771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.334912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.334912] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.338369] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.338530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.338915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4786e88-a231-4c80-a05d-fb642be867ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.339834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.339923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.340439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.340439] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4786e88-a231-4c80-a05d-fb642be867ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.356723] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.358587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.358587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.358587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.359040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.359040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.359040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.359305] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.359418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.359506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.359698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.359772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.359882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.359946] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.473806] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c28844ee-3d37-4737-8b1e-d75a401be9a9: rpc.has_security_group_logging(os_id): False [ 1073.498699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.498699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.498699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.498699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.498699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.498699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.498928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.498928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.499152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.499243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.499469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.499576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.499637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.500469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.500602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.500842] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.501012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.501047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.501366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.501478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.501592] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 is going to be created. [ 1073.585029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.585029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.585029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.585029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.585029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.598188] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: IN_PROGRESS for 2s [ 1073.843517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.843829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.843829] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4786e88-a231-4c80-a05d-fb642be867ad with status ACTIVE [ 1073.844026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.844136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.844203] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.844414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.844503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.844673] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.844768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.844843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.845016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.845096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.845284] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.845376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.845437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.845634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.845724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.845811] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4786e88-a231-4c80-a05d-fb642be867ad is going to be updated. [ 1073.862754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 1073.885998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.885998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.885998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.885998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.885998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.885998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4786e88-a231-4c80-a05d-fb642be867ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.887328] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.887510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.887605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.887860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.887974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.888270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.888404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.888495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.888717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.888820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.889144] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.889274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.889365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.889559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.889664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.889915] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.890090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.890182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.890394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.890472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.890590] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1073.999063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.999267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.999308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.999623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.999826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.027194] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1075.238717] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1075.238717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.238717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.239113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.239113] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.239245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.239307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.239462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.239546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.239666] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.613087] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: SUCCESS [ 1075.613336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.742551] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.044045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1076.044154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.246717] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.752042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.752042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.752256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.752320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.752909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.752909] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1076.787293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.787476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.787577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.787782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.788054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.802713] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1078.333432] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1078.333432] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1078.814615] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1078.814891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.815057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.815207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.815409] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.815527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.815646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.815810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.815894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.815979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.816083] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.318480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.319076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.319225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.319513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.319751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.319882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.320661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.320661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.320661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.320661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.320661] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.320889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.320983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.321166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.321374] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.321485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.321572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.321736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.321836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.321928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.322110] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.824594] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 1079.940292] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.940472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.940472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.940672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.940751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.940990] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.941117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.941183] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.941354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.941436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.941631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.941762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.941814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.941919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.941993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.942187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.942273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.942337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.942487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.943035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.943035] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1080.017046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.017190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.017257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.017573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.017804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.032193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1080.371741] env[65427]: INFO networking_nsxv3.common.synchronization [req-e9b1007f-30bb-4c09-9658-1cfffe82221f req-d71b1726-277e-4023-b221-371094f7fd35 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1080.372134] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1080.372441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.372563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.372665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.372948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.373120] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.373316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.373316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.373508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.373547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.373624] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.876154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.876529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.876529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.876814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.876964] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.877253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.877420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.877462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.877682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.877793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.877930] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1080.915433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.915693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.915805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.916152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.916406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.927135] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1082.036076] env[65427]: INFO networking_nsxv3.common.synchronization [None req-387fbaa6-96de-4670-9d3a-f247b72b00cd None None] Enqueued Resource ID: 334175f2-ff71-4ae9-b65c-900a2904c61c with Priority: HIGHEST for action port [ 1082.036887] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334175f2-ff71-4ae9-b65c-900a2904c61c with Priority: HIGHEST for action port [ 1082.037578] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-334175f2-ff71-4ae9-b65c-900a2904c61c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.037713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334175f2-ff71-4ae9-b65c-900a2904c61c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.037799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334175f2-ff71-4ae9-b65c-900a2904c61c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.038237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334175f2-ff71-4ae9-b65c-900a2904c61c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.038237] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334175f2-ff71-4ae9-b65c-900a2904c61c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.053287] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1082.053673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.541096] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334175f2-ff71-4ae9-b65c-900a2904c61c [ 1082.541505] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.541691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.541825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.542095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.542244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.542383] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334175f2-ff71-4ae9-b65c-900a2904c61c already deleted. [ 1082.542575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334175f2-ff71-4ae9-b65c-900a2904c61c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.938863] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1082.938863] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1082.938863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.368252] env[65427]: INFO networking_nsxv3.common.synchronization [req-d0445a1a-5420-40e9-a0f2-a447143e3436 req-90a7a8ac-227b-4da4-89b9-0cec5dbd04da tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1084.368921] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1084.369556] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.369717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.369916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.370044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.370379] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.370490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.370558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.370720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.370805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.370913] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.873067] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.982645] env[65427]: INFO networking_nsxv3.common.synchronization [None req-34930945-1030-4164-a07c-10cafad6a3dc None None] Enqueued Resource ID: 47faacd3-1227-4529-bd13-c9422c8adb01 with Priority: HIGHEST for action port [ 1084.983309] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47faacd3-1227-4529-bd13-c9422c8adb01 with Priority: HIGHEST for action port [ 1084.983411] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-47faacd3-1227-4529-bd13-c9422c8adb01 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.983560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47faacd3-1227-4529-bd13-c9422c8adb01" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.983617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47faacd3-1227-4529-bd13-c9422c8adb01" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.983872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47faacd3-1227-4529-bd13-c9422c8adb01" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.983916] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47faacd3-1227-4529-bd13-c9422c8adb01',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.375796] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.488570] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47faacd3-1227-4529-bd13-c9422c8adb01 [ 1085.488570] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.488570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.488570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.488570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.488570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.488570] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47faacd3-1227-4529-bd13-c9422c8adb01 already deleted. [ 1085.488570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47faacd3-1227-4529-bd13-c9422c8adb01" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.879496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.879496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.879496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.879717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.879815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.879886] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1085.918221] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.918395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.918480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.919632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.919632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.930358] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1087.120951] env[65427]: INFO networking_nsxv3.common.synchronization [req-d9ba9068-23ad-4794-a090-fa66d76cf746 req-5efc275d-df79-409a-981a-aff223762581 tempest-InstanceActionsTestJSON-1995827160 tempest-InstanceActionsTestJSON-1995827160-project-member] Enqueued Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1087.121282] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGHEST for action security_group_members [ 1087.121835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.121835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.121835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.121835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.125206] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.125206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.125206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.125206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.125206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.125206] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.630631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.630855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.630927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.631671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.631671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.631671] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.631671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.631899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.631899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.631973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.632136] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 is going to be updated. [ 1087.682854] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.682854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.682854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.682854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.682854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.696396] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: IN_PROGRESS for 2s [ 1087.940565] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1087.940786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.084267] env[65427]: INFO networking_nsxv3.common.synchronization [req-0f35742d-ca1d-4ab4-807a-5c4b372c75ab req-de36bea9-7773-4f32-b0c7-e64ec25e1378 tempest-ServerMetadataNegativeTestJSON-1404719794 tempest-ServerMetadataNegativeTestJSON-1404719794-project-member] Enqueued Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1089.084858] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1089.085194] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.085321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.085389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.085689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.085822] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.085928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.085993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.087641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.087746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.088795] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.486504] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-4 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.486816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.486949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.487315] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.487586] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.487758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.487883] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.488119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.488262] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.488465] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.488579] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.488682] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.488789] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.488896] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.488998] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.489143] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.511090] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.511373] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.511495] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.511770] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.512239] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-3ed8ae7e-2597-40e8-a68c-9e19390b3085 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.512448] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.512602] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.513754] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.513938] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed8ae7e-2597-40e8-a68c-9e19390b3085',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.590344] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.590569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.590676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.590962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.591084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.591280] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.591518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.591600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.591839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.591938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.592042] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f already deleted. [ 1089.592128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.707440] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 in Status: SUCCESS [ 1089.707440] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 deletion is rescheduled due to dependency. [ 1089.707440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.017127] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.017445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.017445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.018182] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.018182] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.018182] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 3ed8ae7e-2597-40e8-a68c-9e19390b3085 not found, creating... [ 1090.018285] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.018380] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.018502] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.018713] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.018949] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.019613] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.019613] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.019800] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.020077] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.020245] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.020799] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 3ed8ae7e-2597-40e8-a68c-9e19390b3085 is going to be created. [ 1090.046634] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.046634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.046858] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.047050] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.047322] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.047558] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.805759] env[65427]: INFO networking_nsxv3.common.synchronization [req-cbada8ef-f01a-4e11-b27e-373673ee81fa req-c4949e86-e5a9-4c17-aefb-5270fd91020f tempest-ServersNegativeTestJSON-726626064 tempest-ServersNegativeTestJSON-726626064-project-member] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 1090.806433] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGHEST for action security_group_members [ 1090.806818] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.807019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.807116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.807335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.807508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.807613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.807678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.807830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.807918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.808033] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.209172] env[65427]: INFO networking_nsxv3.common.synchronization [req-0f35742d-ca1d-4ab4-807a-5c4b372c75ab req-b454b861-c817-45eb-a810-2d3da5abe4a8 service nova] Enqueued Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_rules [ 1091.209172] env[65427]: INFO networking_nsxv3.common.synchronization [req-0f35742d-ca1d-4ab4-807a-5c4b372c75ab req-b454b861-c817-45eb-a810-2d3da5abe4a8 service nova] Enqueued Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1091.209172] env[65427]: INFO networking_nsxv3.common.synchronization [req-0f35742d-ca1d-4ab4-807a-5c4b372c75ab req-b454b861-c817-45eb-a810-2d3da5abe4a8 service nova] Enqueued Resource ID: 3ed8ae7e-2597-40e8-a68c-9e19390b3085 with Priority: HIGHEST for action port [ 1091.209593] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_rules [ 1091.209722] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1091.209818] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed8ae7e-2597-40e8-a68c-9e19390b3085 with Priority: HIGHEST for action port [ 1091.211437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.211437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.211437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.211437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.211437] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.212275] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.212850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.212850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.212850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.212850] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.213115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.213115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.213174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.214800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.214800] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.214800] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed8ae7e-2597-40e8-a68c-9e19390b3085 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.214800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.214800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.214800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.215229] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed8ae7e-2597-40e8-a68c-9e19390b3085',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.310877] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.311059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.311135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.311355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.311450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.311664] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.311766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.311831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.311980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.312072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.312164] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be updated. [ 1091.344088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.344245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.344317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.344534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.344681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.354494] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: IN_PROGRESS for 2s [ 1091.713575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.713798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.721249] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.722244] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ed8ae7e-2597-40e8-a68c-9e19390b3085 with status ACTIVE [ 1091.722454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.722575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.722641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.722865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.722970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.723176] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.723289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.723355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.723525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.723627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.723889] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.723987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.724063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.724207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.724281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.724367] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ed8ae7e-2597-40e8-a68c-9e19390b3085 is going to be updated. [ 1091.746997] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.747181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.747262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.747423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.747624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.747751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed8ae7e-2597-40e8-a68c-9e19390b3085" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.227020] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.730154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.730322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.730397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.730622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.730718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.730820] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f is going to be created. [ 1092.758149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.758325] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.758397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.758771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.758813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.769872] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: UNINITIALIZED for 2s [ 1093.366168] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b945fd5-1333-4892-be63-1784a8a66349 in Status: SUCCESS [ 1093.366431] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 deletion is rescheduled due to dependency. [ 1093.366431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.686859] env[65427]: INFO networking_nsxv3.common.synchronization [req-c9865824-1ec3-459c-a5db-b0ccbf935a86 req-99807bb4-afc8-4d93-97b6-566cccf754ba tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1094.689602] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1094.689602] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.696253] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.696253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.696253] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.780551] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: SUCCESS [ 1094.781029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.781029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.781179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.781381] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.781503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.781562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.781715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.781799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.781902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.782042] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.050755] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.051201] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.051394] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.051822] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.052309] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.052559] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.052715] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.053115] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.053382] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.053771] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.054018] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.054260] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.054491] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.054717] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.054929] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.055213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.077369] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.077681] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.077681] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.077966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.078422] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-ccb14f4e-a477-4c1d-8852-121830714b88 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.078571] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.078686] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.079063] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.079211] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb14f4e-a477-4c1d-8852-121830714b88',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.199281] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.199503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.199503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.199782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.199880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.200102] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.200253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.200253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.200419] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.200493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.200579] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1095.227349] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.227553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.227654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.227900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.228099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.238039] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1095.284679] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.284876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.284919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.285176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.285367] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.285473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.285540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.285738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.285863] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.285922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.286057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.286157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.286219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.286366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.286503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.286593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.286655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.286819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.286900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.286980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.287094] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.582306] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.582674] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.582882] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.583294] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.583456] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.583640] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port ccb14f4e-a477-4c1d-8852-121830714b88 not found, creating... [ 1095.583958] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.584201] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.584335] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.584582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.584728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.585088] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.585356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.585551] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.585854] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.586094] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.586306] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: ccb14f4e-a477-4c1d-8852-121830714b88 is going to be created. [ 1095.607718] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.607918] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.608196] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.608552] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.608796] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.609238] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.790769] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee02d41e-1b45-4110-a181-67b0178ab29f: rpc.has_security_group_logging(os_id): False [ 1095.812187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.812644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.812739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.812964] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.813109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.813176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.813343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.813470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.813618] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.813745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.813813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.813921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.814062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.814342] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.814508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.814638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.814860] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.814982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.815134] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f is going to be created. [ 1095.908216] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.908392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.908435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.908650] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.908832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.932646] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: IN_PROGRESS for 2s [ 1096.325988] env[65427]: INFO networking_nsxv3.common.synchronization [req-c9865824-1ec3-459c-a5db-b0ccbf935a86 req-a29aed97-6c7e-4a7e-ac00-933a8c3648bc service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1096.326324] env[65427]: INFO networking_nsxv3.common.synchronization [req-c9865824-1ec3-459c-a5db-b0ccbf935a86 req-a29aed97-6c7e-4a7e-ac00-933a8c3648bc service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1096.326539] env[65427]: INFO networking_nsxv3.common.synchronization [req-c9865824-1ec3-459c-a5db-b0ccbf935a86 req-a29aed97-6c7e-4a7e-ac00-933a8c3648bc service nova] Enqueued Resource ID: ccb14f4e-a477-4c1d-8852-121830714b88 with Priority: HIGHEST for action port [ 1096.327221] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1096.327431] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1096.327558] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb14f4e-a477-4c1d-8852-121830714b88 with Priority: HIGHEST for action port [ 1096.327926] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.328181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.328267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.328519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.328656] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.330368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.330507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.330778] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccb14f4e-a477-4c1d-8852-121830714b88 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.330958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.331086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.331386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.331501] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb14f4e-a477-4c1d-8852-121830714b88',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.835360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.835360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.835360] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccb14f4e-a477-4c1d-8852-121830714b88 with status ACTIVE [ 1096.835360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.835923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.835923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.835923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.835923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.836057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.836179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.836239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.836416] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.836493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.836683] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.836794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.836859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.837042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.837121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.837225] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccb14f4e-a477-4c1d-8852-121830714b88 is going to be updated. [ 1096.861582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.861773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.861856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.862070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.862155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.862307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccb14f4e-a477-4c1d-8852-121830714b88" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.250146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1097.250671] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1097.250671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.250671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.250881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.251180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.251277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.251342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.251550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.251688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.251822] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.757428] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.944572] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: SUCCESS [ 1097.944572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.257181] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.678550] env[65427]: INFO networking_nsxv3.common.synchronization [req-fc68a6bf-04c0-4121-af64-89bbe9ab860f req-4f3d65a4-c006-4f81-8e30-80164605cba2 tempest-ServersWithSpecificFlavorTestJSON-703737974 tempest-ServersWithSpecificFlavorTestJSON-703737974-project-member] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1098.679428] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGHEST for action security_group_members [ 1098.679514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.679770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.679770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.679886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.680372] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.680886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.680980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.681299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.681299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.681500] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.726626] env[65427]: INFO networking_nsxv3.common.synchronization [req-c2806cc6-d1da-488a-a4dc-078c36128860 req-aee4c44a-722b-4186-8ee4-d48d346a4b57 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1098.727262] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGHEST for action security_group_members [ 1098.727638] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.727766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.727836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.728050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.728198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.728297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.728359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.728509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.728593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.728685] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.759321] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.759558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.759558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.759755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.759859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.759960] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1098.794177] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.794384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.794425] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.794603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.794755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.808665] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1099.186321] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.186885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.186885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.186885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.208829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.209123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.209461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.209786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.210260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.210362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.210459] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be updated. [ 1099.231414] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.231956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.231956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.232128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.250785] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.251057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.251057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.251256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.251406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.262159] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: IN_PROGRESS for 2s [ 1099.263793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.264817] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.264817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.264817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.264817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.264817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.264817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 is going to be updated. [ 1099.327981] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.328311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.328311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.328507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.328640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.340274] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: IN_PROGRESS for 2s [ 1100.818625] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1100.819370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.819440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.819716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.819896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.820056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.820056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.820412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.820412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.820412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.820412] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.273093] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 in Status: SUCCESS [ 1101.273319] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 deletion is rescheduled due to dependency. [ 1101.273456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.323243] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.323498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.323607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.323937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.324198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.324317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.324383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.324588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.324643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.325225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.325225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.325225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.325225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.325408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.325566] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.325566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.326139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.326139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.326139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.326139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.326139] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.351404] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c1be55-d441-4f27-a369-9d34ec40f623 in Status: SUCCESS [ 1101.351641] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 deletion is rescheduled due to dependency. [ 1101.351788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.829618] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 1101.847238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.847379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.847460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.847669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.847778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.848151] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.848151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.848279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.848368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.848484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.848665] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.848759] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.848822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.848961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.849053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.849236] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.849327] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.849387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.849519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.849591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.849676] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1101.916967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.917383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.917452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.917675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.917829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.938203] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1102.119302] env[65427]: INFO networking_nsxv3.common.synchronization [req-3aeb46c8-9c33-40c0-8aea-ceb627466e36 req-319f986c-5a8d-44ef-9ecf-e1bb4fe5f95c tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1102.120092] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1102.120494] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.120661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.120738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.120972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.121182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.121305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.121386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.121611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.121727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.121860] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.484819] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.485051] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.485181] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.485445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.486234] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.486427] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.486552] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.486850] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.487070] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.487392] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.487587] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.487760] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.487924] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.488098] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.488225] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.488421] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.513281] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.513281] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.513281] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.513281] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.513281] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-84b3ae99-f243-4db6-97c1-fcd86d114a20 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.513488] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.513526] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.514091] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.514277] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b3ae99-f243-4db6-97c1-fcd86d114a20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.624220] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.017447] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.017767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.017891] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.018195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.018345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.018503] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 84b3ae99-f243-4db6-97c1-fcd86d114a20 not found, creating... [ 1103.018781] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.018979] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.019147] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.019366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.019525] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.019836] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.019978] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.020146] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.020411] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.020550] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.020694] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 84b3ae99-f243-4db6-97c1-fcd86d114a20 is going to be created. [ 1103.042936] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.043212] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.043366] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.043680] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.043926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.044215] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.127163] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.631260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.631430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.631503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.631768] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.631840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.631919] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1103.645820] env[65427]: INFO networking_nsxv3.common.synchronization [req-6eabc929-6855-4e9c-80e6-dc3a18a10c71 req-b742fed3-0ed4-476f-9ce6-5ab03ca33b70 tempest-ServerMetadataNegativeTestJSON-1404719794 tempest-ServerMetadataNegativeTestJSON-1404719794-project-member] Enqueued Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1103.646381] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGHEST for action security_group_members [ 1103.646696] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.646843] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.646972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.647127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.647291] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.647390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.647622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.647622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.647716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.647760] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.661346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.661346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.661346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.661538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.661648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.671548] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1103.757408] env[65427]: INFO networking_nsxv3.common.synchronization [req-3aeb46c8-9c33-40c0-8aea-ceb627466e36 req-b61cf1ae-8a5f-45af-b333-427b7663c089 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1103.757587] env[65427]: INFO networking_nsxv3.common.synchronization [req-3aeb46c8-9c33-40c0-8aea-ceb627466e36 req-b61cf1ae-8a5f-45af-b333-427b7663c089 service nova] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1103.757726] env[65427]: INFO networking_nsxv3.common.synchronization [req-3aeb46c8-9c33-40c0-8aea-ceb627466e36 req-b61cf1ae-8a5f-45af-b333-427b7663c089 service nova] Enqueued Resource ID: 84b3ae99-f243-4db6-97c1-fcd86d114a20 with Priority: HIGHEST for action port [ 1103.758266] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_rules [ 1103.758402] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1103.758499] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b3ae99-f243-4db6-97c1-fcd86d114a20 with Priority: HIGHEST for action port [ 1103.758770] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.758893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.758960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.759398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.759489] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.760906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.761751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.761751] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-84b3ae99-f243-4db6-97c1-fcd86d114a20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.761751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.761751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.761751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.761751] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b3ae99-f243-4db6-97c1-fcd86d114a20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.959103] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1103.959103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.150351] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.150684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.150684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.150808] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.150900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.151117] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.151219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.151282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.151435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.151528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.151595] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f is going to be updated. [ 1104.186996] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.187155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.187223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.187436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.187575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.206787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: IN_PROGRESS for 2s [ 1104.263484] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.263701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.268274] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84b3ae99-f243-4db6-97c1-fcd86d114a20 with status ACTIVE [ 1104.268572] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.269999] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.269999] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.269999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.270723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.270723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.270723] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84b3ae99-f243-4db6-97c1-fcd86d114a20 is going to be updated. [ 1104.327800] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.327800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.327800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.328119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.328173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.328412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84b3ae99-f243-4db6-97c1-fcd86d114a20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.682545] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1105.682890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.682959] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.683163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.683357] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.683477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.683543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.683695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.683810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.683931] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.187033] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.217369] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee02d41e-1b45-4110-a181-67b0178ab29f in Status: SUCCESS [ 1106.217369] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f deletion is rescheduled due to dependency. [ 1106.217369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.689026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.191550] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.191713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.191761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.191983] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.192094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.192197] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1107.224193] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.224397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.224397] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.224627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.224777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.234599] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1108.221715] env[65427]: INFO networking_nsxv3.common.synchronization [req-29eb1967-aa6c-4c40-8092-3c5711e45847 req-e2f45391-fa5f-4648-842c-264270f22284 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1108.222399] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1108.222694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.223018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.223018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.223286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.223588] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.223711] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.223801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.224291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.224517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.224690] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.727371] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.727589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.727655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.728069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.728195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.728387] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.728512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.728583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.728709] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.728795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.728868] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1108.757317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.757558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.757558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.757663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.758267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.767021] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1109.250154] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1109.250519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.250710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.251171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.252988] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.252988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.252988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.252988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.252988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.252988] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.252988] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.754575] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.754767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.754767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.754980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.756533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.756533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.756533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.756533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.758827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.758827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.758827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.758827] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.927716] env[65427]: INFO networking_nsxv3.common.synchronization [None req-47291e01-684a-4032-99da-3c0cab5a0ab3 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1109.928082] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1109.928268] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.928803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.928803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.928905] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.929252] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.016973] env[65427]: INFO networking_nsxv3.common.synchronization [None req-43801c4e-0978-4c22-842a-e4cc751f7618 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1110.017526] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1110.017955] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.017955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.261030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdf134a-d29c-4b39-8d6f-906721fa578b: rpc.has_security_group_logging(os_id): False [ 1110.280265] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.280567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.280700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.281018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.281231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.281489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.281624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.281700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.282044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.282044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.282626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.282626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.282626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.282793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.282793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.282958] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.283079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.283141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.283312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.283403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.283494] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1110.373481] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.373662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.373831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.373932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.374187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.390662] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1110.456632] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.456774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.456835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.457168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.457278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.457478] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 already deleted. [ 1110.457478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.457617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.457803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.457894] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.777730] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1110.777995] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1110.778117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.979026] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.979281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.979281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.979497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.979591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.979691] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 already deleted. [ 1110.979773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.408860] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1112.409273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.162244] env[65427]: INFO networking_nsxv3.common.synchronization [req-82190db1-3b9c-4075-a29b-1b5cbdc9e349 req-89f0f510-2754-4ea5-8c65-a792b7189f4d tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1114.164671] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1114.165971] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.166163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.166263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.166496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.166683] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.166989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.166989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.167189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.167300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.167446] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.554519] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.554926] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.555166] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.555539] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.555928] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.556271] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.556599] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.556956] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.559673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.559673] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.559673] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.559673] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.559673] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.559673] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.559673] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.559673] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.581563] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.581563] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1114.581768] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.581768] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.582091] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-61410d50-6ee8-46d3-87f0-f2b0460a5891 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.582268] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.582400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.582748] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.582889] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61410d50-6ee8-46d3-87f0-f2b0460a5891',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.670084] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.670268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.670342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.670586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.670675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.670914] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.671025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.671085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.671262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.671345] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.671434] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be deleted. [ 1114.705258] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.705471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.705559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.705850] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.706580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.706580] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.085941] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.086203] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.086326] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.086607] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.086806] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.086920] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 61410d50-6ee8-46d3-87f0-f2b0460a5891 not found, creating... [ 1115.087216] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.087380] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.087500] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.087720] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.087855] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.088258] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.088322] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.088419] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.088627] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.088761] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.088899] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 61410d50-6ee8-46d3-87f0-f2b0460a5891 is going to be created. [ 1115.108754] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.109015] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.109110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.109396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.109564] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.109801] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.841620] env[65427]: INFO networking_nsxv3.common.synchronization [req-82190db1-3b9c-4075-a29b-1b5cbdc9e349 req-c1a9906f-b0da-4653-9cd8-5d5bd0ec780b service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1115.841620] env[65427]: INFO networking_nsxv3.common.synchronization [req-82190db1-3b9c-4075-a29b-1b5cbdc9e349 req-c1a9906f-b0da-4653-9cd8-5d5bd0ec780b service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1115.841620] env[65427]: INFO networking_nsxv3.common.synchronization [req-82190db1-3b9c-4075-a29b-1b5cbdc9e349 req-c1a9906f-b0da-4653-9cd8-5d5bd0ec780b service nova] Enqueued Resource ID: 61410d50-6ee8-46d3-87f0-f2b0460a5891 with Priority: HIGHEST for action port [ 1115.842184] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1115.842326] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1115.842593] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61410d50-6ee8-46d3-87f0-f2b0460a5891 with Priority: HIGHEST for action port [ 1115.842695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.842819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.842881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.843124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.843168] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.844335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.844454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.844520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.844701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.844852] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.844943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.845017] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.845158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.845246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.845338] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.846105] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-61410d50-6ee8-46d3-87f0-f2b0460a5891 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.846214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.846429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.846506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.846584] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61410d50-6ee8-46d3-87f0-f2b0460a5891',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.349053] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.349208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.349411] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.350346] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61410d50-6ee8-46d3-87f0-f2b0460a5891 with status ACTIVE [ 1116.350577] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.350729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.350805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.351053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.351188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.351353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.352240] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.352240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.352589] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61410d50-6ee8-46d3-87f0-f2b0460a5891 is going to be updated. [ 1116.379054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.379219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.379219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.379394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.379530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.379690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61410d50-6ee8-46d3-87f0-f2b0460a5891" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.854228] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.356769] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.357058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.357058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.357520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.357723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.357844] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be created. [ 1117.396154] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.396353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.396353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.396536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.396699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.406958] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: UNINITIALIZED for 2s [ 1119.052359] env[65427]: INFO networking_nsxv3.common.synchronization [req-144feca7-4c08-44ad-9c8c-9f92e88df0f3 req-7ac642ef-bc69-4e39-bac7-afa16b5d4d01 tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1119.052695] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1119.053916] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.053916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.053916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.053916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.053916] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.053916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.053916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.054267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.054267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.054336] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.418524] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1119.418763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.418943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.419192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.419431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.419513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.419571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.419770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.419813] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.419903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.420021] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.556681] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.922145] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.922377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.922459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.923090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.923090] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.923090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.923408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.923408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.923408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.923570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.923626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.923772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.923873] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.924114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.924347] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.924486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.924547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.924699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.924784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.924899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.925027] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.059666] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.428033] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a: rpc.has_security_group_logging(os_id): False [ 1120.446695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.446919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.446998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.447320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.447449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.447687] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.447790] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.447855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.448030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.448113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.448323] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.448420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.448484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.448628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.448704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.448887] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.448980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.449040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.449208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.449287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.449375] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be created. [ 1120.509841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.509841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.509841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.510106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.510246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.522631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1120.564051] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.564051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.564051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.564051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.564051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.564051] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1120.613769] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.613991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.614121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.614415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.614624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.625203] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1120.951729] env[65427]: INFO networking_nsxv3.common.synchronization [None req-60b5a59c-3a95-42be-9f68-e929711cc6b5 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1120.952748] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1120.953613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.953613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.953720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.954253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.954653] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.954792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.954893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.955279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.955523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.955726] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.459055] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.961742] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.465549] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.465549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.465549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.465549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.465549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.465549] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1122.480596] env[65427]: INFO networking_nsxv3.common.synchronization [req-87ee30a7-ed6a-4f13-b7b1-ee1f6eeb6410 req-6a94b540-72a1-453b-9db5-774e2e40a20f tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1122.481332] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1122.481730] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.481918] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.482223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.482408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.482651] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.482830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.482912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.483144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.483228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.483329] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.495081] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.495274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.495321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.495530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.495667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.507114] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1122.537279] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1122.537529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.635130] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1122.635374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.800582] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.800582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.800582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.800802] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.801535] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.801535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.801535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.801535] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.801847] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.801847] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.802059] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.802059] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.802186] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.802314] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.802425] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.802567] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.823842] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.824034] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.824180] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.824363] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-324" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.824688] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-c2016058-c141-43d9-96e3-7d0d86371e19 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.824871] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.824995] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.825351] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.825582] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2016058-c141-43d9-96e3-7d0d86371e19',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.985771] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.985989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.985989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.986335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.986491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.986794] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.987012] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.987091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.987306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.987436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.987573] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 already deleted. [ 1122.987708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.084108] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.084291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.084409] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.084681] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.084958] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.085267] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.085394] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.085608] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.085749] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.085993] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.086111] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.086214] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.086343] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.086487] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.086601] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.086743] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.110341] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.110634] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.110879] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.111184] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.111541] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.111726] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.111851] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.112195] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.112350] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.327749] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.327966] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.328160] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.328481] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.328636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.328829] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port c2016058-c141-43d9-96e3-7d0d86371e19 not found, creating... [ 1123.329150] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.329350] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.329489] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.329811] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.330076] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.330534] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.330824] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.330997] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.331234] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.331376] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.331523] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: c2016058-c141-43d9-96e3-7d0d86371e19 is going to be created. [ 1123.353219] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.353449] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.353665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.353987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.354280] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.354521] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.615100] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.615520] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.615520] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.615745] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.615960] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.616147] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 not found, creating... [ 1123.616412] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.616570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.616690] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.616977] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.617139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.617415] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.617570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.617687] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.617919] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.618076] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.618216] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 is going to be created. [ 1123.638063] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.638311] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.638399] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.638668] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.638900] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.639328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.348911] env[65427]: INFO networking_nsxv3.common.synchronization [req-3bd5f85a-19c2-4a3a-98be-66a6e89711b1 req-1a283c80-92d5-4fc6-b1d4-150a08fa8991 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1124.349129] env[65427]: INFO networking_nsxv3.common.synchronization [req-3bd5f85a-19c2-4a3a-98be-66a6e89711b1 req-1a283c80-92d5-4fc6-b1d4-150a08fa8991 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1124.349269] env[65427]: INFO networking_nsxv3.common.synchronization [req-3bd5f85a-19c2-4a3a-98be-66a6e89711b1 req-1a283c80-92d5-4fc6-b1d4-150a08fa8991 service nova] Enqueued Resource ID: b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 with Priority: HIGHEST for action port [ 1124.349806] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1124.349944] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1124.351770] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 with Priority: HIGHEST for action port [ 1124.352106] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.352232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.352302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.352507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.352590] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.353660] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.353760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.354243] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.354370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.354441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.354620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.354702] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.472824] env[65427]: INFO networking_nsxv3.common.synchronization [req-87ee30a7-ed6a-4f13-b7b1-ee1f6eeb6410 req-884c31ea-830e-4860-85cb-c93b4a46f487 service nova] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1124.473230] env[65427]: INFO networking_nsxv3.common.synchronization [req-87ee30a7-ed6a-4f13-b7b1-ee1f6eeb6410 req-884c31ea-830e-4860-85cb-c93b4a46f487 service nova] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1124.473425] env[65427]: INFO networking_nsxv3.common.synchronization [req-87ee30a7-ed6a-4f13-b7b1-ee1f6eeb6410 req-884c31ea-830e-4860-85cb-c93b4a46f487 service nova] Enqueued Resource ID: c2016058-c141-43d9-96e3-7d0d86371e19 with Priority: HIGHEST for action port [ 1124.473979] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_rules [ 1124.474133] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1124.474235] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2016058-c141-43d9-96e3-7d0d86371e19 with Priority: HIGHEST for action port [ 1124.474832] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.474832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.474832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.475115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.475115] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.475812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.476085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.476171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.476767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.477061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.477213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.477306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.477533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.477630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.477750] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.478567] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2016058-c141-43d9-96e3-7d0d86371e19 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.478728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.479106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.481815] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.481815] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2016058-c141-43d9-96e3-7d0d86371e19',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.518988] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1124.519237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.519392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.519600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.519783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.519899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.519972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.520122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.520204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.520299] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.691458] env[65427]: INFO networking_nsxv3.common.synchronization [req-11d18d86-e9f9-4e6f-aab5-1f07528327bb req-bed46091-3530-4f99-98e2-3d0b08fe9563 tempest-AttachVolumeShelveTestJSON-642272812 tempest-AttachVolumeShelveTestJSON-642272812-project-member] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 1124.692057] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGHEST for action security_group_members [ 1124.692397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.692502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.692562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.693213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.693698] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.693937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.694038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.694222] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.694313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.694414] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.859426] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.859599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.859896] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 with status ACTIVE [ 1124.860181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.860445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.860445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.860767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.860922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.861212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.861382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.861554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.861731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.861923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.862220] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.862351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.862678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.862915] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.863064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.863255] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62 is going to be updated. [ 1124.884886] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.884886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.884886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.885180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.885211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.885847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9f78ac1-2345-4d5b-99f5-94b3b7c9fc62" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.907597] env[65427]: INFO networking_nsxv3.common.synchronization [req-c332720b-5a2b-46ce-9922-3d8a2636a2f1 req-73756da9-7573-4b93-8a45-1b2efcaeaac4 tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1124.908208] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1124.908460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.908581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.908648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.908887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.910585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.910725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.910980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.911087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.911181] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.984335] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.984716] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.984817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.986796] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2016058-c141-43d9-96e3-7d0d86371e19 with status ACTIVE [ 1124.986998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.987136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.987189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.987389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.987509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.987737] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.987866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.987930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.988481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.988598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.988799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.988894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.988968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.989128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.989205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.989289] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2016058-c141-43d9-96e3-7d0d86371e19 is going to be updated. [ 1125.025854] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.025854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.025854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.025854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.025854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.025854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2016058-c141-43d9-96e3-7d0d86371e19" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.025854] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.199760] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.199760] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.199760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.199760] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be updated. [ 1125.222592] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.222592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.222592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.222592] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.223311] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.223659] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.224440] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.224897] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.225179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.225667] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.227565] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.227565] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.227565] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.227565] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.227565] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.227565] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.229057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.229408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.229578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.229830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.231833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.241881] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: IN_PROGRESS for 2s [ 1125.253557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.253557] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.253557] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.253557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.253557] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-f7648f3c-9e7d-4f61-908e-e3795090c277 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.253557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.253557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.253557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.253557] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7648f3c-9e7d-4f61-908e-e3795090c277',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.412960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.413148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.413212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.413433] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.413521] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.413720] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.413912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.413980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.414149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.414227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.414317] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b already deleted. [ 1125.414396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.488323] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.532383] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.757178] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.757544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.757544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.757839] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.758032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.758204] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port f7648f3c-9e7d-4f61-908e-e3795090c277 not found, creating... [ 1125.758521] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.758721] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.758872] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.759140] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.759312] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.759639] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.759976] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.760162] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.761240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.761240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.761240] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: f7648f3c-9e7d-4f61-908e-e3795090c277 is going to be created. [ 1125.785807] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.786100] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.786236] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.786509] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.787117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.787117] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.990836] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.991103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.991182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.991440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.991560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991730] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 is going to be created. [ 1126.035661] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.035661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.035661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.035661] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.035832] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.035832] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1126.040078] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.040303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.040303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.040502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.040666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: UNINITIALIZED for 2s [ 1126.079043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.079043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.079257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.079455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.079645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.091589] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1126.539495] env[65427]: INFO networking_nsxv3.common.synchronization [req-c332720b-5a2b-46ce-9922-3d8a2636a2f1 req-e07e4b52-2025-4c34-b18a-8031ec7f62a1 service nova] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_rules [ 1126.540674] env[65427]: INFO networking_nsxv3.common.synchronization [req-c332720b-5a2b-46ce-9922-3d8a2636a2f1 req-e07e4b52-2025-4c34-b18a-8031ec7f62a1 service nova] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1126.541439] env[65427]: INFO networking_nsxv3.common.synchronization [req-c332720b-5a2b-46ce-9922-3d8a2636a2f1 req-e07e4b52-2025-4c34-b18a-8031ec7f62a1 service nova] Enqueued Resource ID: f7648f3c-9e7d-4f61-908e-e3795090c277 with Priority: HIGHEST for action port [ 1126.542289] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_rules [ 1126.542289] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1126.542289] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7648f3c-9e7d-4f61-908e-e3795090c277 with Priority: HIGHEST for action port [ 1126.542507] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.542507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.542645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.542972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.542972] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.548015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.548015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.548015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.548015] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.549112] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7648f3c-9e7d-4f61-908e-e3795090c277 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.549235] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.549352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.549476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.549558] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7648f3c-9e7d-4f61-908e-e3795090c277',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.053141] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.054606] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.054606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.054793] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7648f3c-9e7d-4f61-908e-e3795090c277 with status ACTIVE [ 1127.056058] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.056058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.056058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.056058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.056058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.056058] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.056058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.056898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.057155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.057287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.057531] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.057641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.057721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.057911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.057987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.058104] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7648f3c-9e7d-4f61-908e-e3795090c277 is going to be updated. [ 1127.080582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.080839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.080839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.080997] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.081197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.081365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7648f3c-9e7d-4f61-908e-e3795090c277" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.249793] env[65427]: INFO networking_nsxv3.common.synchronization [req-462eaea1-8fd1-467a-9b03-3c581c223d5c req-e2446dc8-880e-4aaf-997a-66a559fa0690 tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1127.250595] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1127.251734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.251734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.251734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.251734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.251734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.252154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.252154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.252154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.252154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.252286] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.253926] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 in Status: SUCCESS [ 1127.256034] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 deletion is rescheduled due to dependency. [ 1127.256034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.560547] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.669506] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-192 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.669690] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.669821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.670148] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.670528] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.670708] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.670828] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.671075] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.671229] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.671436] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.671551] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.671661] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.671771] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.671883] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.671995] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.672140] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.692053] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.692249] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.692389] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.692573] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-192" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.692924] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.693187] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.693321] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.693670] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.693863] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d1d23c-07dc-40e4-b527-0de8978e6fa3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.756728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.757792] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.757792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.758453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.758453] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1127.793140] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.793315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.793358] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.793571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.793715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.811694] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1128.062796] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.063135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.063135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.063306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.063440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.063562] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be created. [ 1128.066644] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: SUCCESS [ 1128.066854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.067162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.067400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.067612] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.067754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.067856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.068050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.068167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.068280] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.068394] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.088300] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.088300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.088300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.088300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.088300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.098715] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: UNINITIALIZED for 2s [ 1128.099668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1128.099879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.100061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.100259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.100448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.100558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.100623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.100771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.100853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.100938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.101047] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.196637] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.196955] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.197145] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.197463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.197615] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.197771] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port d6d1d23c-07dc-40e4-b527-0de8978e6fa3 not found, creating... [ 1128.198053] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.198219] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.198340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.198557] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.198693] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.198972] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.199142] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.199263] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.199466] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.199600] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.199739] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: d6d1d23c-07dc-40e4-b527-0de8978e6fa3 is going to be created. [ 1128.222842] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.223107] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.223241] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.223536] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.223815] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.224142] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.573593] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.603356] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.603590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.603590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.603846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.604081] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.604201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.604284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.604450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.604528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.604637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.604806] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.604899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.604955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.605165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.605475] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.605566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.605632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.605780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.605904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.605990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.606117] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.965754] env[65427]: INFO networking_nsxv3.common.synchronization [req-462eaea1-8fd1-467a-9b03-3c581c223d5c req-6ec0eb16-ff57-4e25-8372-181d99dfd106 service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1128.969175] env[65427]: INFO networking_nsxv3.common.synchronization [req-462eaea1-8fd1-467a-9b03-3c581c223d5c req-6ec0eb16-ff57-4e25-8372-181d99dfd106 service nova] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1128.969175] env[65427]: INFO networking_nsxv3.common.synchronization [req-462eaea1-8fd1-467a-9b03-3c581c223d5c req-6ec0eb16-ff57-4e25-8372-181d99dfd106 service nova] Enqueued Resource ID: d6d1d23c-07dc-40e4-b527-0de8978e6fa3 with Priority: HIGHEST for action port [ 1128.969175] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_rules [ 1128.969175] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1128.969175] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d1d23c-07dc-40e4-b527-0de8978e6fa3 with Priority: HIGHEST for action port [ 1128.969175] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.969175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.969175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.969175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.969175] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.971101] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.971223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.971513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.971625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.971963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.972462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.972578] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d1d23c-07dc-40e4-b527-0de8978e6fa3',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.142462] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4: rpc.has_security_group_logging(os_id): False [ 1129.142462] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a: rpc.has_security_group_logging(os_id): False [ 1129.159189] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.159347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.159403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.159606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.159725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.159920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.160026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.160090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.160230] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.160306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.160391] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 is going to be created. [ 1129.162243] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.162377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.162450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.162605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.162689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.162861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.162956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.163034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.163192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.163253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.163426] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.163516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.163575] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.163707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.163781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.163950] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.164054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.164113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.164245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.164315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.164395] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1129.258248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.258396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.258455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.258662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.259220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.269564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.269752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.269819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.270093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.270265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.272091] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: IN_PROGRESS for 2s [ 1129.294254] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1129.474210] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.474441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.474629] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6d1d23c-07dc-40e4-b527-0de8978e6fa3 with status ACTIVE [ 1129.476213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.476213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.476213] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.476213] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.476727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.476727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.476727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.476727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.476727] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6d1d23c-07dc-40e4-b527-0de8978e6fa3 is going to be updated. [ 1129.502628] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.503236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.503236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.503236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.503236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.503667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6d1d23c-07dc-40e4-b527-0de8978e6fa3" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.821806] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1129.822013] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1129.822137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.822305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.822645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.822722] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.822805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.823040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.823040] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.823225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.823225] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.109307] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1130.109956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.109956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.109956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.110178] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.110324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.110412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.110616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.110716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.110825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.110939] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.325213] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.613502] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.613735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.614106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.615439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.615774] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.616022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.616128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.616560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.616560] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.616678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.616934] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.617094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.617197] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.617453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.617669] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.617825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.617919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.618126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.618250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.618372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.618499] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.828295] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.121529] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b: rpc.has_security_group_logging(os_id): False [ 1131.143369] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.143607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.143607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.143868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.144124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.144462] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.144631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.144720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.144952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.145086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.145386] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.145600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.145600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.145847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.146125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.146634] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.146634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.146634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.146866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.146866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.146993] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be created. [ 1131.226239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.226466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.226617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.226857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.227077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.240767] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1131.293371] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: SUCCESS [ 1131.293689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.314412] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1131.314726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.330699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.331097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.331097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.331402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.331569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.331755] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1131.366644] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.366835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.366902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.367150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.367326] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.382191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1133.256629] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1133.256629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.393227] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1133.393664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.393955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.394312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.394610] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.394796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.394936] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.395220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.395402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.395507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.395662] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.899018] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.899181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.899305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.899489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.899726] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.899805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.899837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.899960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.900060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.900151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.900300] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.900390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.900446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.900584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.900736] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.900898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.901028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.901145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.901223] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.901293] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.901374] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.968537] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.968537] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1134.403904] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6ac5c0f-07e4-483f-9add-e9bd5d48447e: rpc.has_security_group_logging(os_id): False [ 1134.423188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.423340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.423418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.423640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.423730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.424043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.424153] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.424211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.424399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.424472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.424703] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.424818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.424881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.425032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.425111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.425301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.425392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.425452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.425593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.425663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.425748] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1134.489921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.490135] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.490206] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.490441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.490639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.509749] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1136.209850] env[65427]: INFO networking_nsxv3.common.synchronization [req-d8a11028-d58b-4922-a127-6a9977bbeec2 req-6ea5b48f-9b7d-40b9-852f-79f44e93b56d tempest-ServersTestJSON-1013925504 tempest-ServersTestJSON-1013925504-project-member] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1136.210254] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGHEST for action security_group_members [ 1136.210646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.210778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.210845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.211315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.211315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.211315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.211508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.211508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.211727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.211727] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.530246] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1136.530479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.714130] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.714378] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.714439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.714649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.714748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.714965] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.715077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.715175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.715299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.715361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.715452] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be updated. [ 1136.746232] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.746232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.746232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.746559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.746559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.757047] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: IN_PROGRESS for 2s [ 1136.924651] env[65427]: INFO networking_nsxv3.common.synchronization [req-eb60aaf1-b3c1-4740-ad5a-f41cd87f3624 req-9c074642-2120-44af-a473-82c00f549443 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1136.925235] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1136.925571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.925670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.925708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.925901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.926115] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.926243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.926324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.926518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.926605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.926698] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.428400] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.712631] env[65427]: INFO networking_nsxv3.common.synchronization [None req-b557013b-12a6-4147-99a1-8d3cb506e497 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1137.713113] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1137.713433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.713552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.931520] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.435111] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.435111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.435111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.435111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.435514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.435514] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1138.467553] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.471018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.471018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.471018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.471018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.479560] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1138.767631] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b in Status: SUCCESS [ 1138.767809] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b deletion is rescheduled due to dependency. [ 1138.768170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.482777] env[65427]: INFO networking_nsxv3.common.synchronization [req-d770092c-867f-4de4-89ba-11c3642e47be req-b7f6a0d0-4590-4ec3-8abc-2bab7d7a8238 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1140.483342] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd with Priority: HIGHEST for action security_group_members [ 1140.484084] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a54a063-1f93-4072-9d9d-c355160cc6fd taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.484187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.484305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.484432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.484584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.484681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.484780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.484891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.485025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.485077] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a54a063-1f93-4072-9d9d-c355160cc6fd',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.501634] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1140.501919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.503184] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.503762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.503762] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.503920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.504032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.504232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.504316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.504417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.987294] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.987472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.987533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.987784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.987841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.987993] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.988105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.988163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.988297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.988364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.988450] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd is going to be updated. [ 1141.007866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.007866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.007866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.008151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.008255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.008478] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.008584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.008649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.008818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.008896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.008985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1141.025114] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.025114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.025114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.025523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.025631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.034682] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: IN_PROGRESS for 2s [ 1141.047067] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.047290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.047290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.047436] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.057711] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1143.046090] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd in Status: SUCCESS [ 1143.046404] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a54a063-1f93-4072-9d9d-c355160cc6fd deletion is rescheduled due to dependency. [ 1143.046540] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a54a063-1f93-4072-9d9d-c355160cc6fd" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.072999] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1143.073229] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a deletion is rescheduled due to dependency. [ 1143.073391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.127020] env[65427]: INFO networking_nsxv3.common.synchronization [req-596066de-4905-46d9-bc94-d47930847b71 req-f3ca1289-11ae-4183-a789-8e2cd31380e4 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1145.127667] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGHEST for action security_group_members [ 1145.128035] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.128170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.128505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.128505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.128631] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.128692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.128726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.128876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.128961] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.129081] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.631510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.631702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.631702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.631910] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.657611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.657881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.658009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.658084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.658368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.658475] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.658569] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 is going to be updated. [ 1145.696503] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.696705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.696705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.696927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.697136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.707163] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: IN_PROGRESS for 2s [ 1146.549846] env[65427]: INFO networking_nsxv3.common.synchronization [None req-031a5151-aa26-408d-b060-22f0f2a1033e tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1146.550891] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1146.551693] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.551809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.551849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.552297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.552420] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.652847] env[65427]: INFO networking_nsxv3.common.synchronization [None req-91dd56f1-28a2-45f5-a3de-1181292ed2f3 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1146.653481] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1146.653861] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.653996] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.076101] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.076101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.076101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.076101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.076101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.076101] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 already deleted. [ 1147.076101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.076437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.076484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.076631] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.601413] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.601767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.601767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.601854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.601941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.602037] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 already deleted. [ 1147.602173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.720684] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4c70605-cf21-41b4-b935-773c9e9944e5 in Status: SUCCESS [ 1147.720916] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 deletion is rescheduled due to dependency. [ 1147.721085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.103597] env[65427]: INFO networking_nsxv3.common.synchronization [req-2dab5dea-12c3-4099-9f7a-278dd7411377 req-fef3d2ad-dd29-4468-9f68-b7e88c8a91ef tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1149.104193] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGHEST for action security_group_members [ 1149.104509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.104617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.104689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.104883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.105060] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.105201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.105265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.105403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.105441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.105535] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.610921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.611121] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.611171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.611766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.611883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.612107] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.612212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.612283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.612453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.612531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.612622] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d569034b-409c-4fd2-a968-3cd540fb405e is going to be updated. [ 1149.641111] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.641356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.641356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.641624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.641794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.650793] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: IN_PROGRESS for 2s [ 1150.481025] env[65427]: INFO networking_nsxv3.common.synchronization [req-4fbf139e-b92d-4a09-a181-1cdf619182ff req-01dc516d-7c39-4642-8396-ef0a270dcccb tempest-AttachVolumeTestJSON-2141456544 tempest-AttachVolumeTestJSON-2141456544-project-member] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1150.481457] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGHEST for action security_group_members [ 1150.481800] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.481937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.482091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.482331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.482514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.482621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.482691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.482903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.483043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.483218] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.986069] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.986252] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.986932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.986932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.986932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.986932] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.986932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.987201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.987342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.987342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.987437] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c is going to be updated. [ 1151.026627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.026835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.026835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.027103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.027255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.037259] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: IN_PROGRESS for 2s [ 1151.661045] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d569034b-409c-4fd2-a968-3cd540fb405e in Status: SUCCESS [ 1151.661379] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d569034b-409c-4fd2-a968-3cd540fb405e deletion is rescheduled due to dependency. [ 1151.661379] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.285375] env[65427]: INFO networking_nsxv3.common.synchronization [req-836f6a39-f07d-4495-a243-d8ba98873c82 req-fca1068f-8654-4cad-ad53-ec6b98a47bce tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1152.285435] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1152.285760] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.285886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.285992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.286306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.286479] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.286581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.286645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.286797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.286882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.286978] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.634892] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.635106] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.635232] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.635493] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.635742] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.635897] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.636118] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.636386] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.636537] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.636756] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.636857] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.636962] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.637082] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.637195] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.637302] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.637433] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.660031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.660233] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.660350] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.660533] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.660848] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-bb973a65-c28c-49ef-8f86-b54ed9990696 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.661459] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.661459] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.661459] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.661825] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb973a65-c28c-49ef-8f86-b54ed9990696',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.792017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.792194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.792248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.792480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.792568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.792776] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.792874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.792946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.793165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.793215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.793307] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 already deleted. [ 1152.793392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.048582] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c in Status: SUCCESS [ 1153.048772] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c deletion is rescheduled due to dependency. [ 1153.048895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.164320] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.164596] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.164808] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.165176] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.165418] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.165621] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port bb973a65-c28c-49ef-8f86-b54ed9990696 not found, creating... [ 1153.165938] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.166213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.166348] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.166610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.166755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.167069] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.167230] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.167360] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.167576] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.167707] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.167846] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: bb973a65-c28c-49ef-8f86-b54ed9990696 is going to be created. [ 1153.206767] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207044] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207172] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207447] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207698] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207934] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.903339] env[65427]: INFO networking_nsxv3.common.synchronization [req-836f6a39-f07d-4495-a243-d8ba98873c82 req-10a4cd78-8c49-4120-bdb2-20726815b45e service nova] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1153.903579] env[65427]: INFO networking_nsxv3.common.synchronization [req-836f6a39-f07d-4495-a243-d8ba98873c82 req-10a4cd78-8c49-4120-bdb2-20726815b45e service nova] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1153.903665] env[65427]: INFO networking_nsxv3.common.synchronization [req-836f6a39-f07d-4495-a243-d8ba98873c82 req-10a4cd78-8c49-4120-bdb2-20726815b45e service nova] Enqueued Resource ID: bb973a65-c28c-49ef-8f86-b54ed9990696 with Priority: HIGHEST for action port [ 1153.904241] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1153.904385] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1153.904488] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb973a65-c28c-49ef-8f86-b54ed9990696 with Priority: HIGHEST for action port [ 1153.904839] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.904981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.905113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.905454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.905557] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.906836] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.906836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.906836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.906967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.907059] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.907237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.907237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.907377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.907460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.907554] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.908904] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb973a65-c28c-49ef-8f86-b54ed9990696 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.908904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.908904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.908904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.908904] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb973a65-c28c-49ef-8f86-b54ed9990696',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.411069] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.412103] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.412227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.412555] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb973a65-c28c-49ef-8f86-b54ed9990696 with status ACTIVE [ 1154.412721] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.412829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.412895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.413111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.413211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.413384] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.413452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.413516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.413669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.413746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.413956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.414045] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.414127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.414275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.414351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.414438] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb973a65-c28c-49ef-8f86-b54ed9990696 is going to be updated. [ 1154.435385] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.435599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.435599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.435777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.435914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.436138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb973a65-c28c-49ef-8f86-b54ed9990696" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.913569] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.416799] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.416799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.416799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.416799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.417133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.417133] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be created. [ 1155.443366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.443571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.444995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.444995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.444995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.454064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: UNINITIALIZED for 2s [ 1157.460452] env[65427]: INFO networking_nsxv3.common.synchronization [req-00e43569-680a-41ea-891d-25565edb6ee1 req-de7740f3-6c66-403e-97df-f46cb0ad4f23 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1157.461282] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1157.461282] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.461778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.461778] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.461857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.461972] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.462079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.462138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.462282] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.462362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.462477] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.465332] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1157.465520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.465666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.465831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.466012] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.466180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.466245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.466401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.466481] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.466566] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.466658] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.758378] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.758644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.758712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759016] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.759298] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.759520] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.759709] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759848] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.759998] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.760231] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.760423] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.760480] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.760580] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.760693] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.760818] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.760939] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.781018] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.781250] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.781391] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.781573] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.781893] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.782091] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.782213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.782544] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.782683] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81c4dd1-5d9b-4095-8cf2-1faff7917f5a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.965322] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.965494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.965567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.965807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.968617] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.987193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.987492] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.987655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.987707] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.987883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.987963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.988065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be updated. [ 1158.013685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.013940] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.014019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.014381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.014546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.027542] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 1158.285584] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.285820] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.285948] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.286397] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.286805] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.286990] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port d81c4dd1-5d9b-4095-8cf2-1faff7917f5a not found, creating... [ 1158.287448] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.287762] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.287882] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.289079] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.289263] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.290279] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.290279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.290279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.290279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.290279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.291202] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a is going to be created. [ 1158.310988] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.311378] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.311553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.311810] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.312698] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.312994] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.474519] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b517a9d-1965-4f62-ac9b-62dd080aea20: rpc.has_security_group_logging(os_id): False [ 1158.499027] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.499027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.499027] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.499337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.499337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.499543] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.499644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.499713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.499854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.499929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.500029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be created. [ 1158.564078] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.564267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.564312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.564519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.564699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.578127] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1159.044026] env[65427]: INFO networking_nsxv3.common.synchronization [req-00e43569-680a-41ea-891d-25565edb6ee1 req-f90539a7-9a73-4b76-bd7e-f4ced71924b1 service nova] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_rules [ 1159.044026] env[65427]: INFO networking_nsxv3.common.synchronization [req-00e43569-680a-41ea-891d-25565edb6ee1 req-f90539a7-9a73-4b76-bd7e-f4ced71924b1 service nova] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1159.044026] env[65427]: INFO networking_nsxv3.common.synchronization [req-00e43569-680a-41ea-891d-25565edb6ee1 req-f90539a7-9a73-4b76-bd7e-f4ced71924b1 service nova] Enqueued Resource ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with Priority: HIGHEST for action port [ 1159.044539] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_rules [ 1159.044674] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1159.044773] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with Priority: HIGHEST for action port [ 1159.045057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.045212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.045284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.045477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.045560] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.047012] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.047176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.047389] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.047493] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.047605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.047794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.047899] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81c4dd1-5d9b-4095-8cf2-1faff7917f5a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.549949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.550368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.552396] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with status ACTIVE [ 1159.552621] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.552757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.552831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.553990] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.553990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.554400] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.554400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.554400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.554549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.554549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.554607] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a is going to be updated. [ 1159.578378] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.578597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.578597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.578773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.578911] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.579084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.036888] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 1160.037078] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b deletion is rescheduled due to dependency. [ 1160.037220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.037383] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.037622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.037794] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.037908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.037973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.038150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.038238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.038324] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.541152] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.590583] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1160.590834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.043240] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.545820] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.545979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.546127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.546317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.546410] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.546512] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be updated. [ 1161.575346] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.575539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.575581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.575757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.575903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.584231] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 1163.595353] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 1163.595686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.595780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.595955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.596224] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.596364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.596414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.596578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.596658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.596746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.596838] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.045551] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1164.045752] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1164.099388] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.099567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.099609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.099925] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.100168] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.100295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.100368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.100570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.100679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.100811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.100979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.101126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.101192] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.101365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.101519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.101611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.101700] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.101856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.101947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.102052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.102154] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.605604] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a66c3424-adb0-472b-bb3b-fbb14607817b: rpc.has_security_group_logging(os_id): False [ 1164.626582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.626794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.626794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.626992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.627132] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.627517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.627662] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.627735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.628127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.628127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.628241] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.628343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.628431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.628593] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.628643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.628899] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.629300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.629553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.629728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.629814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.629985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be updated. [ 1164.691167] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.691472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.691472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.691623] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.691722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.706335] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 1166.080696] env[65427]: INFO networking_nsxv3.common.synchronization [None req-588c172f-7a52-49d8-ad6d-72b072ac5973 tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: 4566df74-2be7-4bb3-b656-0afad3b64630 with Priority: HIGHEST for action security_group_rules [ 1166.081302] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4566df74-2be7-4bb3-b656-0afad3b64630 with Priority: HIGHEST for action security_group_rules [ 1166.081664] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4566df74-2be7-4bb3-b656-0afad3b64630 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.081847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.081942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.082233] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.082322] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4566df74-2be7-4bb3-b656-0afad3b64630',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.173997] env[65427]: INFO networking_nsxv3.common.synchronization [None req-c0580816-1f67-4d5a-9149-dd1f39442bf4 tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: 4566df74-2be7-4bb3-b656-0afad3b64630 with Priority: HIGHEST for action security_group_rules [ 1166.174516] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4566df74-2be7-4bb3-b656-0afad3b64630 with Priority: HIGHEST for action security_group_rules [ 1166.174828] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4566df74-2be7-4bb3-b656-0afad3b64630 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.175024] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.602301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.602474] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.602516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.602814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.602899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.603011] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4566df74-2be7-4bb3-b656-0afad3b64630 already deleted. [ 1166.603220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.603281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.603570] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.603656] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4566df74-2be7-4bb3-b656-0afad3b64630',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.695300] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b350747-4df2-4904-8356-db64007de309 req-45d834a8-4a00-425b-a604-4f96596f18c0 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1166.695605] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGHEST for action security_group_members [ 1166.695636] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.695771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.695824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.696371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.696585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.696698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.696764] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.696927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.697025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.697144] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.719342] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 1166.719576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.739914] env[65427]: INFO networking_nsxv3.common.synchronization [req-1b350747-4df2-4904-8356-db64007de309 req-45d834a8-4a00-425b-a604-4f96596f18c0 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with Priority: HIGHEST for action port [ 1166.740586] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with Priority: HIGHEST for action port [ 1166.740893] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.742055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.742304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.742468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.742606] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d81c4dd1-5d9b-4095-8cf2-1faff7917f5a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.127724] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.128137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.128137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.128238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.128299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.128889] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4566df74-2be7-4bb3-b656-0afad3b64630 already deleted. [ 1167.129268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4566df74-2be7-4bb3-b656-0afad3b64630" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.199171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.199781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.199781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.199781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.199781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.199976] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.200062] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.200129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.200289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.200366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.200457] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be updated. [ 1167.227585] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.227733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.227805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.228015] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.228169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.237949] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: IN_PROGRESS for 2s [ 1167.244373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d81c4dd1-5d9b-4095-8cf2-1faff7917f5a with status ACTIVE [ 1167.244522] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.244701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.244701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.244909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.244992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.245204] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.245308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.245365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.245613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.245613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.245768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.245857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.245919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.246079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.246189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.246277] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d81c4dd1-5d9b-4095-8cf2-1faff7917f5a is going to be updated. [ 1167.268149] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.268369] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.268486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.268704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.268840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.268995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d81c4dd1-5d9b-4095-8cf2-1faff7917f5a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.251164] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66c3424-adb0-472b-bb3b-fbb14607817b in Status: SUCCESS [ 1169.251581] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b deletion is rescheduled due to dependency. [ 1169.251581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.761040] env[65427]: INFO networking_nsxv3.common.synchronization [req-c37ea484-2385-4ee3-be48-62d287318360 req-2ff3b671-9e7f-44aa-b286-1c93d7dad7a9 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1170.762167] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1170.762682] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.762871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.763081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.763336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.763564] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.763713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.763810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.764255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.764420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.764586] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.158560] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.158756] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.158918] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.159368] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.159649] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.159816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.159931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.160182] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.160337] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.160578] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.160695] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.160803] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.160910] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.161199] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.161199] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.161298] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.181610] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.181824] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.181968] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.182162] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.182473] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-e28b9f17-3efe-4e28-837d-77cbed545095 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.182647] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.182765] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.183096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.183245] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28b9f17-3efe-4e28-837d-77cbed545095',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.267495] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.686013] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.686445] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.686622] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.687114] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.687180] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.687737] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port e28b9f17-3efe-4e28-837d-77cbed545095 not found, creating... [ 1171.687737] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.687941] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.688013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.688478] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.688478] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.688805] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.689022] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.689179] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.689862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.689862] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.689862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: e28b9f17-3efe-4e28-837d-77cbed545095 is going to be created. [ 1171.711508] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.711673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.711673] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.711958] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.712213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.712463] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.770546] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.272995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.273299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.273299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.273389] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.273483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.273742] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be updated. [ 1172.301179] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.301299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.301348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.301801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.301801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.311776] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1172.427996] env[65427]: INFO networking_nsxv3.common.synchronization [req-c37ea484-2385-4ee3-be48-62d287318360 req-4a574c25-ab99-4ff7-9133-3d26be3ae5e0 service nova] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1172.428442] env[65427]: INFO networking_nsxv3.common.synchronization [req-c37ea484-2385-4ee3-be48-62d287318360 req-4a574c25-ab99-4ff7-9133-3d26be3ae5e0 service nova] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1172.428442] env[65427]: INFO networking_nsxv3.common.synchronization [req-c37ea484-2385-4ee3-be48-62d287318360 req-4a574c25-ab99-4ff7-9133-3d26be3ae5e0 service nova] Enqueued Resource ID: e28b9f17-3efe-4e28-837d-77cbed545095 with Priority: HIGHEST for action port [ 1172.428920] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_rules [ 1172.429080] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1172.429173] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e28b9f17-3efe-4e28-837d-77cbed545095 with Priority: HIGHEST for action port [ 1172.429458] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.429585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.429655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.429855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.429941] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.430793] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.431680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.431680] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-e28b9f17-3efe-4e28-837d-77cbed545095 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.431680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.431680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.431680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.431680] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28b9f17-3efe-4e28-837d-77cbed545095',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.584646] env[65427]: INFO networking_nsxv3.common.synchronization [req-06fae1e3-32eb-4a00-9240-ef03e22ac72f req-e7838ad5-5be8-410a-8933-9887e52a2c9f tempest-DeleteServersTestJSON-1130557071 tempest-DeleteServersTestJSON-1130557071-project-member] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1172.585224] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGHEST for action security_group_members [ 1172.585513] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.585631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.585691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.585888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.586249] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.586249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.586249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.586388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.586418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.586513] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.933642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.933642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.934112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e28b9f17-3efe-4e28-837d-77cbed545095 with status ACTIVE [ 1172.934112] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.934112] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.934287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.934390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.934519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.934720] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.934809] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.934887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.935083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.935162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.935398] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.935496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.935558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.935741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.936251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.936251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e28b9f17-3efe-4e28-837d-77cbed545095 is going to be updated. [ 1172.960947] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.961181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.961296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.961567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.961716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.961879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e28b9f17-3efe-4e28-837d-77cbed545095" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.088524] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.088682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.088755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.088976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.089085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.089307] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.089418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.089467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.089611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.089688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.089779] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be updated. [ 1173.115919] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.116207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.116347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.116587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.116706] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.133615] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: IN_PROGRESS for 2s [ 1174.326343] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1174.326881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.326881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.327224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.327287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.327421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.327485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.327698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.327749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.327839] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.830544] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.144476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e in Status: SUCCESS [ 1175.145022] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e deletion is rescheduled due to dependency. [ 1175.145214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.332678] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.835871] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.835992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.837401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.837401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.837401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.837401] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be updated. [ 1175.843206] env[65427]: INFO networking_nsxv3.common.synchronization [req-571e3946-ba46-4f3a-807e-7cd14b3b9b4b req-b9b55a8a-00f1-4139-b65c-040866e59ab3 tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1175.844402] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1175.844783] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.844885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.844932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.845148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.845300] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.845395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.845454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.845597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.845676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.845959] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.879118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.879350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.879350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.879494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.879605] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.890014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1176.189980] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.190234] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.190332] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.190610] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.190862] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.191145] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.191327] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.191550] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.191698] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.191908] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.192033] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.192141] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.192249] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.192467] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.192583] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.192714] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.214526] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.214764] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.214827] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.214999] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-197" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.215358] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.215531] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.215663] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.215991] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.216232] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.348700] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.718655] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.718900] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.719044] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.719396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.719683] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.719824] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 not found, creating... [ 1176.720140] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.720324] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.720503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.720821] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.720910] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.721252] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.721416] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.721534] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.721764] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.721985] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.722148] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 is going to be created. [ 1176.744708] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.744916] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.745056] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.745359] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.745595] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.745877] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.851166] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.353949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.354335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.354335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.354473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.354582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.354688] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be updated. [ 1177.398271] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.398515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.398515] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.398767] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.398891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.413671] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1177.525578] env[65427]: INFO networking_nsxv3.common.synchronization [req-571e3946-ba46-4f3a-807e-7cd14b3b9b4b req-9c1f5361-99d7-4c48-992f-b50810fc0424 service nova] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_rules [ 1177.525762] env[65427]: INFO networking_nsxv3.common.synchronization [req-571e3946-ba46-4f3a-807e-7cd14b3b9b4b req-9c1f5361-99d7-4c48-992f-b50810fc0424 service nova] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1177.525907] env[65427]: INFO networking_nsxv3.common.synchronization [req-571e3946-ba46-4f3a-807e-7cd14b3b9b4b req-9c1f5361-99d7-4c48-992f-b50810fc0424 service nova] Enqueued Resource ID: 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 with Priority: HIGHEST for action port [ 1177.526622] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_rules [ 1177.526697] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1177.526795] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 with Priority: HIGHEST for action port [ 1177.528088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.528215] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.528286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.528525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.528666] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.529587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.529690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.529891] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.529991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.530134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.530243] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.530322] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.917046] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1177.917405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.917678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.918033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.918351] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.918562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.918679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.918952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.919134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.919316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.919465] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.032843] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.033093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.033365] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 with status ACTIVE [ 1178.033648] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.033770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.033848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.034092] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.034211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.034455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.034576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.034659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.034840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.034939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.035838] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.035838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.035838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.035838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.035838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.036116] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9 is going to be updated. [ 1178.059814] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.059977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.060053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.060269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.060414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.060583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c0ed7e-cc5b-4c2e-a582-951ae90c1ea9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.422217] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.644317] env[65427]: INFO networking_nsxv3.common.synchronization [req-1a1ec37a-a738-4f03-ae70-3cca53f8e490 req-c79f66e5-cbf0-48f5-b75b-56a6249072a2 tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1178.644317] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGHEST for action security_group_members [ 1178.644317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.644780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.644780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.644780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.644780] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.644927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.644957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.645311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.645407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.645549] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.924719] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b517a9d-1965-4f62-ac9b-62dd080aea20: rpc.has_security_group_logging(os_id): False [ 1178.944460] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.944659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.944696] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.944896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.944990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945279] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.945374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.945468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.945624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.945728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945778] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be updated. [ 1179.029345] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.029674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.029805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.030136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.030368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.089985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1179.148734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.148947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.148986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.149285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.149390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.149637] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.149749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.149816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.150038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.150193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.150241] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb is going to be updated. [ 1179.189979] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.191033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.191033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.191033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.191033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.201819] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: IN_PROGRESS for 2s [ 1179.431627] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1179.431627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.431627] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.432367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.432367] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.432367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.432367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.432587] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.432678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.432821] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.936643] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.439772] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.943517] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.943692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.943763] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.944126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.944347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.944498] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be updated. [ 1181.031485] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.031485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.031485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.031485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.031485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.050407] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1181.132509] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1181.132509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.212557] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: IN_PROGRESS for 4s [ 1183.074732] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1183.075156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.075156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.075387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.075598] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.075727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.075794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.075981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.076076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.076357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.076470] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.164225] env[65427]: INFO networking_nsxv3.common.synchronization [None req-ee8d43e4-2f66-40c4-9410-6348d8cf8e80 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1183.164843] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1183.165188] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.165323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.165388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.165585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.165742] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.165825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.165887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.166096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.166142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.166257] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.225259] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb in Status: SUCCESS [ 1183.225460] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb deletion is rescheduled due to dependency. [ 1183.225576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.580614] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.580797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.580841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.581053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.581995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.581995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.581995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.582390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.582390] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.582390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.582390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.582516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.582571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.582647] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.582749] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.668533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.668533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.668533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.668533] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.668826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.668857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.669036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.669036] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.669157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.669217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.669310] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1183.699497] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.699719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.699719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.699920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.700086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.709325] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1184.085960] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b: rpc.has_security_group_logging(os_id): False [ 1184.106170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.106403] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.106502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.106757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.106829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.107020] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.107120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.107178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.107360] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.107453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.107635] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.107739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.107829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.108053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.108162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.108353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.108449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.108519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.108649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.108718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.108824] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be updated. [ 1184.189768] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.189976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.190095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.190323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.190482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.210020] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1185.720282] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1185.720564] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a deletion is rescheduled due to dependency. [ 1185.720601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.228841] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1186.228841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.848248] env[65427]: INFO networking_nsxv3.common.synchronization [None req-5dbab558-028e-4911-83a2-01b74e7cdd39 None None] Enqueued Resource ID: c3300b4d-cb49-4709-8ddc-240054cea673 with Priority: HIGHEST for action port [ 1186.848734] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3300b4d-cb49-4709-8ddc-240054cea673 with Priority: HIGHEST for action port [ 1186.849076] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3300b4d-cb49-4709-8ddc-240054cea673 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.849180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3300b4d-cb49-4709-8ddc-240054cea673" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.849180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3300b4d-cb49-4709-8ddc-240054cea673" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.849536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3300b4d-cb49-4709-8ddc-240054cea673" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.849647] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3300b4d-cb49-4709-8ddc-240054cea673',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.352146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3300b4d-cb49-4709-8ddc-240054cea673 [ 1187.352146] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.352146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.352146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.352146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.352146] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.352146] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3300b4d-cb49-4709-8ddc-240054cea673 already deleted. [ 1187.352784] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3300b4d-cb49-4709-8ddc-240054cea673" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.474345] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3c6ea862-c574-4705-a04d-36846a94d3bd None None] Enqueued Resource ID: 68f427a0-0e9d-44c8-931a-505cd90d6b55 with Priority: HIGHEST for action port [ 1188.475488] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f427a0-0e9d-44c8-931a-505cd90d6b55 with Priority: HIGHEST for action port [ 1188.475995] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f427a0-0e9d-44c8-931a-505cd90d6b55 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.476220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f427a0-0e9d-44c8-931a-505cd90d6b55" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.476353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f427a0-0e9d-44c8-931a-505cd90d6b55" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.476743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f427a0-0e9d-44c8-931a-505cd90d6b55" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.477032] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f427a0-0e9d-44c8-931a-505cd90d6b55',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.567929] env[65427]: INFO networking_nsxv3.common.synchronization [req-5c48ae5d-ed06-41a6-9130-198434ecad18 req-b7bdbbec-d64d-45e6-b5ac-93ee44a3a7a9 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1188.569819] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1188.569819] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.569819] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.570039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.570147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.570322] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.570499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.570499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.571884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.571884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.571884] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.979635] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f427a0-0e9d-44c8-931a-505cd90d6b55 [ 1188.981317] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.981317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.981317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.981317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.981317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.981317] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f427a0-0e9d-44c8-931a-505cd90d6b55 already deleted. [ 1188.981317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f427a0-0e9d-44c8-931a-505cd90d6b55" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.074544] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.074752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.075106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.075137] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.075229] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.075433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.075543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.075973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.075973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.075973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.075973] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1189.158175] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.158366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.158439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.158654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.158804] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.183070] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1189.299580] env[65427]: INFO networking_nsxv3.common.synchronization [req-f9a4da6c-2824-475f-9a58-2aaa7068b41e req-ba4028e6-2708-49cd-9e55-442fdbcbb2a8 tempest-AttachVolumeNegativeTest-1707084127 tempest-AttachVolumeNegativeTest-1707084127-project-member] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1189.299827] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGHEST for action security_group_members [ 1189.300287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.300432] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.300490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.300690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.301022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.301022] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.301185] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.303820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.303942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.304101] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.741042] env[65427]: INFO networking_nsxv3.common.synchronization [None req-0ec583d6-f5b9-436f-9e7f-4d1afa4bea54 None None] Enqueued Resource ID: f55e4ae4-a96e-421a-ae88-17f2c77bbdeb with Priority: HIGHEST for action port [ 1189.741622] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55e4ae4-a96e-421a-ae88-17f2c77bbdeb with Priority: HIGHEST for action port [ 1189.741941] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f55e4ae4-a96e-421a-ae88-17f2c77bbdeb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.744026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f55e4ae4-a96e-421a-ae88-17f2c77bbdeb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.744026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f55e4ae4-a96e-421a-ae88-17f2c77bbdeb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.744026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f55e4ae4-a96e-421a-ae88-17f2c77bbdeb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.744026] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f55e4ae4-a96e-421a-ae88-17f2c77bbdeb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.807455] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.807544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.807544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.808792] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.808792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.808792] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 is going to be updated. [ 1189.848043] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.848865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.848865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.848865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.848865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.859473] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: IN_PROGRESS for 2s [ 1190.245700] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f55e4ae4-a96e-421a-ae88-17f2c77bbdeb [ 1190.246015] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.246205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.246455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.246742] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.246903] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.246953] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f55e4ae4-a96e-421a-ae88-17f2c77bbdeb already deleted. [ 1190.247049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f55e4ae4-a96e-421a-ae88-17f2c77bbdeb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.678033] env[65427]: INFO networking_nsxv3.common.synchronization [req-1ca0300d-b234-4842-9c96-9c9674076e98 req-4cc5a542-57ff-479f-8da0-a85a6bacefec tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 1190.679322] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 1190.679526] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.679670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.679820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.680048] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.680334] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.680334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.680445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.680516] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.680603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.680699] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.806137] env[65427]: INFO networking_nsxv3.common.synchronization [None req-2eb118e0-f473-42e5-8e86-2fa2ad084d6d None None] Enqueued Resource ID: 7a41ab6e-be81-4a17-87f9-e93497f2e95b with Priority: HIGHEST for action port [ 1190.806493] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a41ab6e-be81-4a17-87f9-e93497f2e95b with Priority: HIGHEST for action port [ 1190.807649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a41ab6e-be81-4a17-87f9-e93497f2e95b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.807649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a41ab6e-be81-4a17-87f9-e93497f2e95b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.807649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a41ab6e-be81-4a17-87f9-e93497f2e95b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.807834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a41ab6e-be81-4a17-87f9-e93497f2e95b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.807834] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a41ab6e-be81-4a17-87f9-e93497f2e95b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.185613] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.203041] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1191.203041] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 deletion is rescheduled due to dependency. [ 1191.203041] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.311493] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a41ab6e-be81-4a17-87f9-e93497f2e95b [ 1191.311753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.311891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.311955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.312440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.312541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.312643] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a41ab6e-be81-4a17-87f9-e93497f2e95b already deleted. [ 1191.312724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a41ab6e-be81-4a17-87f9-e93497f2e95b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.687798] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.790028] env[65427]: INFO networking_nsxv3.common.synchronization [req-877e75ab-2bf2-40d6-8d02-dc2e9cb7d15b req-13e14a83-d499-45d5-b4c5-3f82437cbba8 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1191.790535] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1191.790844] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.790967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.791056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.791247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.791537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.791537] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.791718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.791718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.791866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.791866] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.872507] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 in Status: SUCCESS [ 1191.872767] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 deletion is rescheduled due to dependency. [ 1191.872803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.120839] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.121057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.121183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.122057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.122057] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.122057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.122057] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.122308] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.122599] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.122599] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.122671] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.123242] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.123242] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.123242] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.123242] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.123242] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.145790] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.145790] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1192.145790] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.145790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-675" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.145790] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-688ddc7d-afde-4e79-9819-4d338d484f7f taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.145790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.145790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.146758] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.147140] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('688ddc7d-afde-4e79-9819-4d338d484f7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.193380] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.193380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.193380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.193380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.193380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.193380] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 1192.224219] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.224219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.224219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.224219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.224219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.233630] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 1192.293476] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.649617] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.649906] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.650103] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.650473] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.650674] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.650878] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 688ddc7d-afde-4e79-9819-4d338d484f7f not found, creating... [ 1192.651241] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.651447] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.651582] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.651804] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.651945] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.652408] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.652602] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.652736] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.652989] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.653168] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.653332] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 688ddc7d-afde-4e79-9819-4d338d484f7f is going to be created. [ 1192.675622] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.675876] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.676009] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.676384] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.676750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.676887] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.796483] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.299499] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.299814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.299814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.299882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.300440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.300440] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be updated. [ 1193.347780] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.347948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.347948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.348186] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.348346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.359127] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 1193.428572] env[65427]: INFO networking_nsxv3.common.synchronization [req-877e75ab-2bf2-40d6-8d02-dc2e9cb7d15b req-a5fe6d04-8bb3-4339-b511-36e416567ba3 service nova] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 1193.428783] env[65427]: INFO networking_nsxv3.common.synchronization [req-877e75ab-2bf2-40d6-8d02-dc2e9cb7d15b req-a5fe6d04-8bb3-4339-b511-36e416567ba3 service nova] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1193.428925] env[65427]: INFO networking_nsxv3.common.synchronization [req-877e75ab-2bf2-40d6-8d02-dc2e9cb7d15b req-a5fe6d04-8bb3-4339-b511-36e416567ba3 service nova] Enqueued Resource ID: 688ddc7d-afde-4e79-9819-4d338d484f7f with Priority: HIGHEST for action port [ 1193.429481] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_rules [ 1193.429578] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1193.429768] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 688ddc7d-afde-4e79-9819-4d338d484f7f with Priority: HIGHEST for action port [ 1193.429967] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.430171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.430171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.430404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.430484] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.431872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.431872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.431872] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-688ddc7d-afde-4e79-9819-4d338d484f7f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.431872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.431872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.432216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.432216] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('688ddc7d-afde-4e79-9819-4d338d484f7f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.933908] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.934164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.934302] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 688ddc7d-afde-4e79-9819-4d338d484f7f with status ACTIVE [ 1193.934469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.934582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.934651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.934826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.934928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.935136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.935275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.935351] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.935450] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.935527] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.935707] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.935791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.935852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.935984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.936072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.936158] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 688ddc7d-afde-4e79-9819-4d338d484f7f is going to be updated. [ 1193.958251] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.958492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.958492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.958770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.958946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.959165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-688ddc7d-afde-4e79-9819-4d338d484f7f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.244291] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 1194.244364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.385040] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 1195.385449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.385594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.385835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.386121] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.386323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.386401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.386578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.386680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.386807] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.889097] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.394584] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.898075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.898075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.898075] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.898312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.898312] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.898371] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be updated. [ 1196.941864] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.942056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.942165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.942460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.942632] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.952802] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 1197.165032] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.165032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.165213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.165434] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.165689] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.165841] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.165958] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.166183] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.166362] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.166592] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.166733] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.166813] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.166918] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.167032] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.167140] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.167303] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.186154] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.186154] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1197.186418] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.186529] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.186864] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-b17bebcf-671b-477d-850f-5ee654d07afc taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.187046] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.187167] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.187666] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.187818] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17bebcf-671b-477d-850f-5ee654d07afc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.690383] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.690922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.690922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.691305] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.691540] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.691761] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port b17bebcf-671b-477d-850f-5ee654d07afc not found, creating... [ 1197.692132] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.692593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.692593] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.692968] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.693313] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.693615] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.693845] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.694219] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.694389] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.694787] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.694988] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: b17bebcf-671b-477d-850f-5ee654d07afc is going to be created. [ 1197.704687] env[65427]: INFO networking_nsxv3.common.synchronization [req-f35825f2-110d-4f08-a676-b246cd10cf36 req-5fcc7ec8-42f5-4f8f-b60d-87ed1b521d84 tempest-ServersNegativeTestMultiTenantJSON-127240544 tempest-ServersNegativeTestMultiTenantJSON-127240544-project-member] Enqueued Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1197.705306] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1197.705708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.705900] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.705958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.706346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.706546] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.706671] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.706738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.706921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.707034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.707173] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.716806] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.717176] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.717176] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.717527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.717720] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.717950] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.049851] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-466 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.050107] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-466" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.050239] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-466" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.050569] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-466" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.050840] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.050998] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.051134] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.051395] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.051549] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.051761] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.051877] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.051988] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.052124] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.052237] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.052372] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.052524] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.085770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.086070] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.086235] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.086503] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-466" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.086879] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.087135] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.087385] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.087794] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.087957] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a74a8d1-79d2-47f9-b184-f8cfefdd5c69',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.210496] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.210648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.210713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.210949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.211054] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.211262] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.211400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.211467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.211595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.211660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.211744] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 already deleted. [ 1198.211821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.436398] env[65427]: INFO networking_nsxv3.common.synchronization [req-54419a4a-7252-499b-b267-347885b7d621 req-b65eb852-2229-4490-9ec6-798979b3b188 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1198.436592] env[65427]: INFO networking_nsxv3.common.synchronization [req-54419a4a-7252-499b-b267-347885b7d621 req-b65eb852-2229-4490-9ec6-798979b3b188 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1198.437097] env[65427]: INFO networking_nsxv3.common.synchronization [req-54419a4a-7252-499b-b267-347885b7d621 req-b65eb852-2229-4490-9ec6-798979b3b188 service nova] Enqueued Resource ID: b17bebcf-671b-477d-850f-5ee654d07afc with Priority: HIGHEST for action port [ 1198.437385] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1198.437538] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1198.437642] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17bebcf-671b-477d-850f-5ee654d07afc with Priority: HIGHEST for action port [ 1198.437929] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.438107] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.438145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.438337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.438415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.439290] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.439411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.439472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.439641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.439794] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.439885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.440096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.440151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.440201] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.440296] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.441073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b17bebcf-671b-477d-850f-5ee654d07afc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.441173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.441261] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.441747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.441747] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17bebcf-671b-477d-850f-5ee654d07afc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.591474] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.591729] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.591857] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.592178] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.592397] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.592574] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 not found, creating... [ 1198.592890] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.593071] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.593192] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.593423] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.593567] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.593847] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.594010] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.594665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.594665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.594665] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.594842] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 is going to be created. [ 1198.617887] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.618210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.618400] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.618776] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.619139] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.619461] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.943335] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.944677] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.944677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.945666] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b17bebcf-671b-477d-850f-5ee654d07afc with status ACTIVE [ 1198.945931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.946042] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.946344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.946525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.946525] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.946810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.946810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.946914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.947765] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.947765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.948123] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b17bebcf-671b-477d-850f-5ee654d07afc is going to be updated. [ 1198.974148] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 1198.974373] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.974548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.974766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.974985] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.975087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.975157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.975331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.975483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.975648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.975648] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.977303] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.977465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.977465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.978339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.978339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.978339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.315151] env[65427]: INFO networking_nsxv3.common.synchronization [req-f35825f2-110d-4f08-a676-b246cd10cf36 req-509d6c51-7cea-4e26-a24b-9cca63b0eb7e service nova] Enqueued Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_rules [ 1199.315439] env[65427]: INFO networking_nsxv3.common.synchronization [req-f35825f2-110d-4f08-a676-b246cd10cf36 req-509d6c51-7cea-4e26-a24b-9cca63b0eb7e service nova] Enqueued Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1199.315678] env[65427]: INFO networking_nsxv3.common.synchronization [req-f35825f2-110d-4f08-a676-b246cd10cf36 req-509d6c51-7cea-4e26-a24b-9cca63b0eb7e service nova] Enqueued Resource ID: 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 with Priority: HIGHEST for action port [ 1199.316529] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_rules [ 1199.316750] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1199.316942] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 with Priority: HIGHEST for action port [ 1199.317397] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.317581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.317689] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.318056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.318674] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.319709] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.319795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.320320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.320559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.320642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320753] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.321361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.321361] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.322539] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.323655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.323655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.323655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.323655] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a74a8d1-79d2-47f9-b184-f8cfefdd5c69',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.446433] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.479428] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.826174] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826174] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.827210] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 with status ACTIVE [ 1199.827428] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.827550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.827624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.827842] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.827937] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.828139] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.828240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.828311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.828485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.828588] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.828785] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.828874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.828938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.829134] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.829165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.829251] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a74a8d1-79d2-47f9-b184-f8cfefdd5c69 is going to be updated. [ 1199.853749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.853935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.854037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.854344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.854491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.854651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a74a8d1-79d2-47f9-b184-f8cfefdd5c69" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.948920] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.949273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.949273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.949541] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.949669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.949810] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1199.981676] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d451ec0-7db8-47cf-a4b7-45518e01097b: rpc.has_security_group_logging(os_id): False [ 1200.012065] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.012303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.012303] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.012536] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.014748] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.014902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.014990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.015219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.015420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.026817] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1200.048142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.048338] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.048420] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.048486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.048898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.048987] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.049112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be updated. [ 1200.134495] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.134655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.134727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.134951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.135119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.153644] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 1200.331731] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.833881] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.834073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.834148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.834390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.834485] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.834594] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 is going to be created. [ 1200.859618] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.859780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.859886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.860086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.860254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.870664] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: UNINITIALIZED for 2s [ 1201.403183] env[65427]: INFO networking_nsxv3.common.synchronization [req-5b43cf75-1d06-4130-82d1-7f4a494e107b req-0faba38f-b8f2-4d02-9563-1dcd203450c9 tempest-ServerRescueNegativeTestJSON-1695869202 tempest-ServerRescueNegativeTestJSON-1695869202-project-member] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 1201.403780] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGHEST for action security_group_members [ 1201.404199] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.404538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.404538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.404635] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.404777] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.404874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.404930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.405091] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.405177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.405274] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.885152] env[65427]: INFO networking_nsxv3.common.synchronization [req-def56110-fefb-4134-87d7-5c72e3b468f2 req-7527bc7a-39c4-4ee0-9ccf-38d2b4efca1f tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1201.885152] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1201.885152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.885152] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.885152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.885994] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.909803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.909803] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.909803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.909803] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be updated. [ 1201.936367] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.936726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.936891] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.937190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.937467] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.952417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: IN_PROGRESS for 2s [ 1202.038231] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1202.039231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.039231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.039231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.039231] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.039231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.039231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.039529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.039529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.039529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.039625] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.170731] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 1202.170968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.206434] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.206636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.206759] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.207092] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.207367] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.208268] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.208268] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.208268] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.208268] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.209323] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1202.209443] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.209567] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.209666] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.210142] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1202.210309] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.210417] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.230420] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.230598] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1202.230735] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.230923] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.231270] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-a1428493-819b-4fbf-8e4b-fdc84818a95c taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.231450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.231574] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.231903] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.232057] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1428493-819b-4fbf-8e4b-fdc84818a95c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.388733] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.388893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.388893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.389956] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.389956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.389956] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1202.418857] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.418857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.418857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.419275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.419275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.429877] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1202.541725] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.541906] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.541969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.542342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.542645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.542829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.542929] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.543217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.543392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.543535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.543597] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.543723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.543788] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.543883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.544055] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.544170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.544277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.544458] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.544550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.544645] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.544702] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.735371] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.735527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.736120] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.736120] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.736249] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.736543] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port a1428493-819b-4fbf-8e4b-fdc84818a95c not found, creating... [ 1202.736994] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.737285] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.737469] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.737866] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.738096] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.738580] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.738849] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.739020] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.739345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.739566] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.739777] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: a1428493-819b-4fbf-8e4b-fdc84818a95c is going to be created. [ 1202.762042] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.762042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.762042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.762584] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.763346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.763346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.885374] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: SUCCESS [ 1202.885663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.885870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.886154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.886480] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.886561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.886651] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.886835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.886949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.887065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.887174] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.048719] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a: rpc.has_security_group_logging(os_id): False [ 1203.070368] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.070626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.070896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.071295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.071686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.071686] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.071967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.072021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.072256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.072371] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.072665] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.072828] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.072927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.073194] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.073330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.073590] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.073744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.073837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.074052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.074196] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.074416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1203.143170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.143352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.143414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.143620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.143785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.165509] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1203.390655] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.390881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.390958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.391285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.391545] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.391718] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.391827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.392093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.392236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.392368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.392607] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.392748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.392839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.393034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.393186] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.393283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.393348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.393517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.393599] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.393683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.393775] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.532109] env[65427]: INFO networking_nsxv3.common.synchronization [req-def56110-fefb-4134-87d7-5c72e3b468f2 req-1d39ab45-4d67-4061-a3d4-09c3403824bb service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 1203.532353] env[65427]: INFO networking_nsxv3.common.synchronization [req-def56110-fefb-4134-87d7-5c72e3b468f2 req-1d39ab45-4d67-4061-a3d4-09c3403824bb service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1203.532454] env[65427]: INFO networking_nsxv3.common.synchronization [req-def56110-fefb-4134-87d7-5c72e3b468f2 req-1d39ab45-4d67-4061-a3d4-09c3403824bb service nova] Enqueued Resource ID: a1428493-819b-4fbf-8e4b-fdc84818a95c with Priority: HIGHEST for action port [ 1203.537050] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 1203.537225] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1203.537405] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1428493-819b-4fbf-8e4b-fdc84818a95c with Priority: HIGHEST for action port [ 1203.538075] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.538145] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.538212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.538422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.538518] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.542598] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.542598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.542598] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1428493-819b-4fbf-8e4b-fdc84818a95c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.542598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.542598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.542598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.542598] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1428493-819b-4fbf-8e4b-fdc84818a95c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.895667] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afc0d389-bdfb-4be8-835d-7aa3fb82fdb5: rpc.has_security_group_logging(os_id): False [ 1203.913949] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.914151] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.914333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.914513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.914607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.914843] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.914945] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.915019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.915182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.915264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.915478] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.915573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.915636] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.915775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.915849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.916057] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.916204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.916286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.916460] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.916538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.916627] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 is going to be created. [ 1203.966818] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07e38e11-5e71-4d2b-b175-0954d843dabf in Status: SUCCESS [ 1203.967021] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf deletion is rescheduled due to dependency. [ 1203.967142] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.974510] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.974657] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.974721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.974927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.975122] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.988668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: IN_PROGRESS for 2s [ 1204.043382] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.043551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.043711] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1428493-819b-4fbf-8e4b-fdc84818a95c with status ACTIVE [ 1204.043887] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.043995] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.044109] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.044364] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.044491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.044681] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.044782] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.044846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.045013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.045096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.045285] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.045382] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.045445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.045586] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.045755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.045755] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1428493-819b-4fbf-8e4b-fdc84818a95c is going to be updated. [ 1204.084254] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.084455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.084455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.084677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.084840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.084975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1428493-819b-4fbf-8e4b-fdc84818a95c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.439571] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1204.439815] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 deletion is rescheduled due to dependency. [ 1204.439887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.440047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.440290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.440483] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.440601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.440667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.440822] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.440907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.441013] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.943603] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.182577] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1205.182795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.445343] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.948450] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.948811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.948811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.948917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.948980] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.949093] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1205.983662] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.983861] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.983914] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.984130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.984287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.997187] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1206.000634] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: SUCCESS [ 1206.000872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.010059] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1208.010412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.010565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.010716] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.010921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.011056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.011123] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.011285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.011392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.011490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.011601] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.514431] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.538782] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1208.538962] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1209.016588] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546f1ff4-ef91-4671-86b3-d15ea6055715: rpc.has_security_group_logging(os_id): False [ 1209.035960] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.036162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.036210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.036601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.036754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.037207] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.037340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.037407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.037595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.037695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.037787] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1209.099324] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.099324] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.099624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.099624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.099703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.115928] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1210.490103] env[65427]: INFO networking_nsxv3.common.synchronization [req-7eed0c04-0de9-44c7-9ef9-df1440695604 req-76fb0a27-76ae-4ff2-ae37-3c935e985f1e tempest-ServersNegativeTestMultiTenantJSON-127240544 tempest-ServersNegativeTestMultiTenantJSON-127240544-project-member] Enqueued Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1210.490489] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGHEST for action security_group_members [ 1210.490571] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.490736] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.490810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.493297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.493297] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.493297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.493297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.493297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.493297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.493297] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.994379] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.995322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.995322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.995322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.995322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.995811] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.995811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.995811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.995811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.996258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.996258] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 is going to be updated. [ 1211.029809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.030093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.030093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.030238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.030391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.061133] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: IN_PROGRESS for 2s [ 1211.134218] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1211.134774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.076283] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 in Status: SUCCESS [ 1213.076690] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 deletion is rescheduled due to dependency. [ 1213.076690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.491054] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.491338] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.548176] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.548408] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.548558] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.549252] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.549548] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.549723] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.549843] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.550137] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.550234] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.550447] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.550563] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.550677] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.550843] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.550978] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.551106] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.551529] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.573064] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.573305] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.573450] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.573705] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-166" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.574049] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-b17bebcf-671b-477d-850f-5ee654d07afc taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.574246] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.574346] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.574606] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.574743] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17bebcf-671b-477d-850f-5ee654d07afc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.078428] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.078901] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.082029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.082029] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.082029] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.082505] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.083288] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.083514] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.083587] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: b17bebcf-671b-477d-850f-5ee654d07afc is going to be updated. [ 1216.118040] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.118279] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.118396] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.118681] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.118915] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.119166] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.809431] env[65427]: INFO networking_nsxv3.common.synchronization [req-5dcf93b1-3fe1-46ce-bff1-2440f23410b8 req-299cbb4d-c7ff-41ad-80f4-392aab5e9c15 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1216.809722] env[65427]: INFO networking_nsxv3.common.synchronization [req-5dcf93b1-3fe1-46ce-bff1-2440f23410b8 req-299cbb4d-c7ff-41ad-80f4-392aab5e9c15 service nova] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1216.809866] env[65427]: INFO networking_nsxv3.common.synchronization [req-5dcf93b1-3fe1-46ce-bff1-2440f23410b8 req-299cbb4d-c7ff-41ad-80f4-392aab5e9c15 service nova] Enqueued Resource ID: b17bebcf-671b-477d-850f-5ee654d07afc with Priority: HIGHEST for action port [ 1216.810565] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_rules [ 1216.810565] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1216.811136] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b17bebcf-671b-477d-850f-5ee654d07afc with Priority: HIGHEST for action port [ 1216.811753] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.811883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.811954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.812178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.812266] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.814619] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.814730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.814797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.815178] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.815178] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.815279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.815279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.815616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.816428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.816549] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.817365] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-b17bebcf-671b-477d-850f-5ee654d07afc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.817476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.817545] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.817735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.817790] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b17bebcf-671b-477d-850f-5ee654d07afc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.315191] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.315631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.319955] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b17bebcf-671b-477d-850f-5ee654d07afc with status ACTIVE [ 1217.320584] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.320584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.320584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.320829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.320869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.321054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.321161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.321224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.321376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.321456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.321640] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.321733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.321793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.321930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.322009] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.322099] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b17bebcf-671b-477d-850f-5ee654d07afc is going to be updated. [ 1217.323205] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.347208] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.347453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.347453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.347694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.347858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.348065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b17bebcf-671b-477d-850f-5ee654d07afc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.825263] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.329507] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.329507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.329507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.329507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.329507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.329507] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1218.362837] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.362837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.362837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.363119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.363119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.372705] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1220.384029] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1220.384283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.384283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.384544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.384778] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.384894] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.384991] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.385167] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.385263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.385355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.385451] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.888818] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.888818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.888818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.888818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.889289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.889289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.889289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.889289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.889289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.889469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.889469] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.889554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.889615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.889752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.889888] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.889976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.890047] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.890180] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.890254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.890331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.890419] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.393127] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a: rpc.has_security_group_logging(os_id): False [ 1221.410638] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.410796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.410841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.411086] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.411181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.411409] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.411509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.411569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.411748] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.411840] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.412042] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.412138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.412200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.412336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.412409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.412588] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.412679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.412738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.412871] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.412942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.413040] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1221.473161] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.473453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.473453] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.473603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.473715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.508451] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1221.811888] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.812113] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1223.532226] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1223.532719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.813360] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.813788] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1227.401341] env[65427]: INFO networking_nsxv3.common.synchronization [req-423a522f-4e3e-44ab-b826-45e702c5750c req-6835fa34-7f50-419e-b8fa-5dbc275c1e26 tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1227.402384] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1227.402587] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.402792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.402792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.403044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.404066] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.404066] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.404204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.404374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.404512] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.404659] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.907418] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.409966] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.912822] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.913228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.913228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.913308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.913376] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.913477] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be updated. [ 1228.949061] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.949250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.949313] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.949655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.949655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.959915] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1230.972560] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1230.972942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.282169] env[65427]: INFO networking_nsxv3.common.synchronization [req-d1a46e61-4c7c-47c0-8f50-6fdf86f6d9a1 req-7842619b-647a-4f24-ad89-f27c3da9b36b tempest-MigrationsAdminTest-1535081561 tempest-MigrationsAdminTest-1535081561-project-member] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1232.283250] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGHEST for action security_group_members [ 1232.283250] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.283250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.283250] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.283479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.283515] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.283622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.283682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.283827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.283912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.283999] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.786616] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.786814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.786854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.787111] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.787207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.787411] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.787603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.787603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.787727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.787841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.787898] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be updated. [ 1232.824214] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.824424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.824424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.824585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.824729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.833617] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: IN_PROGRESS for 2s [ 1233.509434] env[65427]: INFO networking_nsxv3.common.synchronization [req-13961503-c0d1-47bb-a097-dbc293a5956e req-e57e4156-f8c1-42dc-9287-062427368425 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1233.509896] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1233.510226] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.510621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.510621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.510621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.510773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.510836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.511827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.511827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.511827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.511827] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.013309] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.516610] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.846444] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b in Status: SUCCESS [ 1234.846693] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b deletion is rescheduled due to dependency. [ 1234.846806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.018264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.018437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.018548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.018954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.019057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.019176] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be updated. [ 1235.048446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.048646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.048646] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.048845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.048994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.058586] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1237.070461] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1237.070829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.511109] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1238.511109] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1239.858361] env[65427]: INFO networking_nsxv3.common.synchronization [req-a0d21de2-a9b3-4fb0-8a0c-85f8464fbe4d req-26f4408f-7daf-40ea-98c8-859aca79596d tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1239.859037] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGHEST for action security_group_members [ 1239.859441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.859534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.859571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.859775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.859965] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.860320] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.860390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.860554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.860642] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.861082] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.363489] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.363666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.363714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.363928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.364090] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.364304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.364413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.364478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.364648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.364728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.364818] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be updated. [ 1240.411649] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.411878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.411878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.412114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.412210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.422901] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: IN_PROGRESS for 2s [ 1242.433015] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 in Status: SUCCESS [ 1242.433407] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 deletion is rescheduled due to dependency. [ 1242.433407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.532466] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4f91936a-1e11-443e-98ed-c32992d18116 None None] Enqueued Resource ID: 9871fd87-952b-4790-a2c3-b9b534e1d1e1 with Priority: HIGHEST for action port [ 1243.533059] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9871fd87-952b-4790-a2c3-b9b534e1d1e1 with Priority: HIGHEST for action port [ 1243.533371] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-9871fd87-952b-4790-a2c3-b9b534e1d1e1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.533528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9871fd87-952b-4790-a2c3-b9b534e1d1e1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.533571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9871fd87-952b-4790-a2c3-b9b534e1d1e1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.533807] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9871fd87-952b-4790-a2c3-b9b534e1d1e1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.533896] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9871fd87-952b-4790-a2c3-b9b534e1d1e1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.037065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9871fd87-952b-4790-a2c3-b9b534e1d1e1 [ 1244.037065] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.037065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.037065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.037065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.037065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.037065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9871fd87-952b-4790-a2c3-b9b534e1d1e1 already deleted. [ 1244.037065] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9871fd87-952b-4790-a2c3-b9b534e1d1e1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.287567] env[65427]: INFO networking_nsxv3.common.synchronization [None req-09371386-9d86-4bd5-9625-07bc32e46ea1 tempest-AttachInterfacesTestJSON-1949185989 tempest-AttachInterfacesTestJSON-1949185989-project-member] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1244.288143] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGHEST for action security_group_members [ 1244.288450] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.288571] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.288641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.288854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.289071] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.289182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.289247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.289404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.289488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.289583] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.792802] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.792802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.792802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.792802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.793237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.793237] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.793237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.793237] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.793372] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.793424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.793754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be updated. [ 1244.820750] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.820847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.820883] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.821426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.821426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.830607] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: IN_PROGRESS for 2s [ 1245.684176] env[65427]: INFO networking_nsxv3.common.synchronization [None req-06ba3987-4cf5-43b9-b8a6-1c89d296df26 None None] Enqueued Resource ID: f4f12877-5ced-4082-ae96-d7d682ce5a8c with Priority: HIGHEST for action port [ 1245.684655] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f12877-5ced-4082-ae96-d7d682ce5a8c with Priority: HIGHEST for action port [ 1245.684947] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4f12877-5ced-4082-ae96-d7d682ce5a8c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.685082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4f12877-5ced-4082-ae96-d7d682ce5a8c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.685152] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4f12877-5ced-4082-ae96-d7d682ce5a8c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.685400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4f12877-5ced-4082-ae96-d7d682ce5a8c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.685482] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4f12877-5ced-4082-ae96-d7d682ce5a8c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.187340] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4f12877-5ced-4082-ae96-d7d682ce5a8c [ 1246.187702] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.187702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.187820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.188400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.188400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.188400] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4f12877-5ced-4082-ae96-d7d682ce5a8c already deleted. [ 1246.188400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4f12877-5ced-4082-ae96-d7d682ce5a8c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.841743] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a in Status: SUCCESS [ 1246.841961] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a deletion is rescheduled due to dependency. [ 1246.842084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.271783] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.272044] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.078603] env[65427]: INFO networking_nsxv3.common.synchronization [None req-d6640e6b-f6d3-46e4-a8bf-f784a80af4f3 None None] Enqueued Resource ID: f9864e48-a632-47d5-ac06-9fd53eef1cc0 with Priority: HIGHEST for action port [ 1248.079100] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9864e48-a632-47d5-ac06-9fd53eef1cc0 with Priority: HIGHEST for action port [ 1248.079414] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9864e48-a632-47d5-ac06-9fd53eef1cc0 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.079542] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9864e48-a632-47d5-ac06-9fd53eef1cc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.079613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9864e48-a632-47d5-ac06-9fd53eef1cc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.079870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9864e48-a632-47d5-ac06-9fd53eef1cc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.079957] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9864e48-a632-47d5-ac06-9fd53eef1cc0',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.506115] env[65427]: INFO networking_nsxv3.common.synchronization [req-c0888ddf-9b47-4b53-8d9e-16dfe67e58ec req-759eb0ce-7209-467a-8519-d660a0ff128d tempest-ServerAddressesTestJSON-1006052695 tempest-ServerAddressesTestJSON-1006052695-project-member] Enqueued Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1248.506804] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1248.507148] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.507267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.507336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.507573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.507734] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.507864] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.507956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.508169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.508290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.508431] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.583345] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9864e48-a632-47d5-ac06-9fd53eef1cc0 [ 1248.583502] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.583629] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.583694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.583907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.584016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.584177] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9864e48-a632-47d5-ac06-9fd53eef1cc0 already deleted. [ 1248.584177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9864e48-a632-47d5-ac06-9fd53eef1cc0" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.804142] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-45 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.804371] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.805197] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.805540] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.805856] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.806104] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.806271] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.806501] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.806712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.806938] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.807061] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.807171] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.807282] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.807392] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1248.807498] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.807790] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.832661] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.832661] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1248.832661] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.832904] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-45" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.833129] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-ced01caf-ea3f-4ebd-aade-300bee83d0f4 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.833313] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.833461] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.833774] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.833915] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ced01caf-ea3f-4ebd-aade-300bee83d0f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.010866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.011099] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.011188] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.011409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.012030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.012030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.012030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.012030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.012030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.012315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.012315] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012c551d-0850-41f9-b582-af4eec5efe34 already deleted. [ 1249.012315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.337351] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.337649] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.337779] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.338110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.338419] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.338497] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port ced01caf-ea3f-4ebd-aade-300bee83d0f4 not found, creating... [ 1249.339110] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.339110] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.339317] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.339444] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.339722] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.340102] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.340291] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.340439] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.340677] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.340846] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.340997] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: ced01caf-ea3f-4ebd-aade-300bee83d0f4 is going to be created. [ 1249.363972] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.364247] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.364382] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.364799] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.365032] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.365287] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.066937] env[65427]: INFO networking_nsxv3.common.synchronization [req-c0888ddf-9b47-4b53-8d9e-16dfe67e58ec req-be681abf-e57c-4153-8426-44fe001ccf03 service nova] Enqueued Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_rules [ 1250.067251] env[65427]: INFO networking_nsxv3.common.synchronization [req-c0888ddf-9b47-4b53-8d9e-16dfe67e58ec req-be681abf-e57c-4153-8426-44fe001ccf03 service nova] Enqueued Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1250.067362] env[65427]: INFO networking_nsxv3.common.synchronization [req-c0888ddf-9b47-4b53-8d9e-16dfe67e58ec req-be681abf-e57c-4153-8426-44fe001ccf03 service nova] Enqueued Resource ID: ced01caf-ea3f-4ebd-aade-300bee83d0f4 with Priority: HIGHEST for action port [ 1250.067944] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_rules [ 1250.068096] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1250.068199] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ced01caf-ea3f-4ebd-aade-300bee83d0f4 with Priority: HIGHEST for action port [ 1250.068475] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.068664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.068664] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.068920] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.069054] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.069943] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.070098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.070200] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.070456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.070786] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.070944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.071049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.071749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.071749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.071749] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.072463] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-ced01caf-ea3f-4ebd-aade-300bee83d0f4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.072578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.072644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.074367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.074367] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ced01caf-ea3f-4ebd-aade-300bee83d0f4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.422940] env[65427]: INFO networking_nsxv3.common.synchronization [None req-3d373f05-ccd4-4f02-bea4-639d654952c8 None None] Enqueued Resource ID: 593796ee-a5cf-459f-ab1b-7bd336ed5dd9 with Priority: HIGHEST for action port [ 1250.423508] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593796ee-a5cf-459f-ab1b-7bd336ed5dd9 with Priority: HIGHEST for action port [ 1250.423831] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-593796ee-a5cf-459f-ab1b-7bd336ed5dd9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.423953] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593796ee-a5cf-459f-ab1b-7bd336ed5dd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.424039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593796ee-a5cf-459f-ab1b-7bd336ed5dd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.424308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593796ee-a5cf-459f-ab1b-7bd336ed5dd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.424411] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593796ee-a5cf-459f-ab1b-7bd336ed5dd9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.576049] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.576049] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.576049] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.576504] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ced01caf-ea3f-4ebd-aade-300bee83d0f4 with status ACTIVE [ 1250.576504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.576504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.576504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.576737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.576737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.576925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.577028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.577095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.577254] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.577498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.577764] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.577901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.577989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.578181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.578277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.578385] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ced01caf-ea3f-4ebd-aade-300bee83d0f4 is going to be updated. [ 1250.601908] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.602074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.602163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.602430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.602600] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.602792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ced01caf-ea3f-4ebd-aade-300bee83d0f4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.928106] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 593796ee-a5cf-459f-ab1b-7bd336ed5dd9 [ 1250.928106] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.928106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.928106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.928106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.928106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.928106] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:593796ee-a5cf-459f-ab1b-7bd336ed5dd9 already deleted. [ 1250.928550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593796ee-a5cf-459f-ab1b-7bd336ed5dd9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.080295] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.583190] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.583459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.583578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.583902] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.584056] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.584203] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012c551d-0850-41f9-b582-af4eec5efe34 is going to be created. [ 1251.610777] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.610947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.611013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.611211] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.611513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.622797] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: UNINITIALIZED for 2s [ 1253.491943] env[65427]: INFO networking_nsxv3.common.synchronization [req-41f74fde-d6c0-43f3-b9c0-bb5ba51be131 req-f6253edb-8e6c-41a4-8b14-9e11e9a84337 tempest-ServerRescueTestJSON-1330040637 tempest-ServerRescueTestJSON-1330040637-project-member] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1253.492522] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1253.492834] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.492956] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.493064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.493331] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.493494] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.493596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.493659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.493802] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.493887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.493979] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.633541] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: SUCCESS [ 1253.633845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.634094] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.634366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.634647] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.634811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.634931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.635155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.635286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.635428] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.635567] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.745947] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.746162] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.746290] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.746669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.746968] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.747293] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.747434] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.747662] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.747804] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.748024] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.748143] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.748253] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.748363] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.748475] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.748584] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.748715] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.795081] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.795245] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1253.795391] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.795570] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.795889] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-960fa27f-79b8-4c39-bd1f-152b138ca94d taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.796091] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.796217] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.796634] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.796777] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960fa27f-79b8-4c39-bd1f-152b138ca94d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.996172] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.996365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.996464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.996766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.996886] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.997128] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.997238] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.997329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.997494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.997573] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.997679] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 already deleted. [ 1253.997776] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.138142] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.138357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.138357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.138595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.138769] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.138870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.139076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.139294] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.139393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.139491] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.139654] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.139756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.139820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.139963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.140147] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.140270] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.140334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.140504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.140589] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.140688] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.140802] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.299560] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.299787] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.300011] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.300363] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.300559] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.300748] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 960fa27f-79b8-4c39-bd1f-152b138ca94d not found, creating... [ 1254.301090] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.301349] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.301527] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.301794] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.301969] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.302307] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.302501] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.302646] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.302889] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.303046] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.303190] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 960fa27f-79b8-4c39-bd1f-152b138ca94d is going to be created. [ 1254.325634] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.325886] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.325993] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.326345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.326645] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.326920] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.643759] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 012c551d-0850-41f9-b582-af4eec5efe34: rpc.has_security_group_logging(os_id): False [ 1254.661722] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.661927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.661927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.662159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.662246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.662444] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.662543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.662606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.662756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.662829] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.663025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.663119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.663181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.663314] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.663386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.663567] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.663659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.663721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.663882] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.663962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.664058] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 012c551d-0850-41f9-b582-af4eec5efe34 is going to be created. [ 1254.728136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.728295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.728343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.728552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.728727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.739171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: IN_PROGRESS for 2s [ 1255.015337] env[65427]: INFO networking_nsxv3.common.synchronization [req-41f74fde-d6c0-43f3-b9c0-bb5ba51be131 req-b95fc643-1ec4-48b8-b089-4f3c1a102111 service nova] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_rules [ 1255.015533] env[65427]: INFO networking_nsxv3.common.synchronization [req-41f74fde-d6c0-43f3-b9c0-bb5ba51be131 req-b95fc643-1ec4-48b8-b089-4f3c1a102111 service nova] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1255.015671] env[65427]: INFO networking_nsxv3.common.synchronization [req-41f74fde-d6c0-43f3-b9c0-bb5ba51be131 req-b95fc643-1ec4-48b8-b089-4f3c1a102111 service nova] Enqueued Resource ID: 960fa27f-79b8-4c39-bd1f-152b138ca94d with Priority: HIGHEST for action port [ 1255.016200] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_rules [ 1255.016339] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1255.016437] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960fa27f-79b8-4c39-bd1f-152b138ca94d with Priority: HIGHEST for action port [ 1255.016727] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.016853] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.016921] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.021386] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.021519] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.024998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.025377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.025487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.025704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.025914] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.026085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.027799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.027971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.028081] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.028182] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.029232] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-960fa27f-79b8-4c39-bd1f-152b138ca94d taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.029381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.029631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.031624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.031624] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960fa27f-79b8-4c39-bd1f-152b138ca94d',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.532604] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.533812] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.533931] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.534318] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 960fa27f-79b8-4c39-bd1f-152b138ca94d with status ACTIVE [ 1255.534527] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.534682] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.534730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.534922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.535011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.535196] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.535291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.535347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.535499] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.535577] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.535756] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.535879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.535917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.536038] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.536113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.536193] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 960fa27f-79b8-4c39-bd1f-152b138ca94d is going to be updated. [ 1255.557736] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.557899] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.557942] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.558266] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.558302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.558429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-960fa27f-79b8-4c39-bd1f-152b138ca94d" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.035046] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.537264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.537461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.537506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.537755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.537847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.537950] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be created. [ 1256.561098] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.561295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.561295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.561511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.561669] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.570050] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: UNINITIALIZED for 2s [ 1256.750373] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: SUCCESS [ 1256.750579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.580259] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1258.580563] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.580624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.580830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.581036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.581157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.581217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.581367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.581444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.581529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.581620] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.084361] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.084621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.084728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.085018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.085270] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.085396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.085492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.085714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.085827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.085922] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.086136] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.086268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.086336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.086495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.086836] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.087011] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.087163] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.087380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.087513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.087648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.087813] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.591090] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92093753-0a5b-4859-8d42-30b3241d5251: rpc.has_security_group_logging(os_id): False [ 1259.608334] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.608508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.608554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.608755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.608870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.609118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.609220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.609286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.609441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.609518] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.609695] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.609805] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.609897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.610061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.610139] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.610320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.610412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.610473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.610610] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.610683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.610769] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be created. [ 1259.664032] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.664199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.664245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.664466] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.664676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.677335] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1260.008090] env[65427]: INFO networking_nsxv3.common.synchronization [req-d2babdd6-df51-4e05-8ebf-4828f422cce5 req-be360217-8eaf-40ad-be76-091dbd6589c0 tempest-ServerAddressesTestJSON-1006052695 tempest-ServerAddressesTestJSON-1006052695-project-member] Enqueued Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1260.008090] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 012c551d-0850-41f9-b582-af4eec5efe34 with Priority: HIGHEST for action security_group_members [ 1260.008338] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-012c551d-0850-41f9-b582-af4eec5efe34 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.008517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.008665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.008947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.009229] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.009388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.009534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.009770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.009935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.010128] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('012c551d-0850-41f9-b582-af4eec5efe34',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.512747] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.512943] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.512989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.513244] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.513300] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.513502] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.513602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.513666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.513817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.513897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.513985] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012c551d-0850-41f9-b582-af4eec5efe34 is going to be updated. [ 1260.542475] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.542639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.542684] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.542890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.543043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.552289] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: IN_PROGRESS for 2s [ 1261.688909] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1261.689337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.562093] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 012c551d-0850-41f9-b582-af4eec5efe34 in Status: SUCCESS [ 1262.562301] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 012c551d-0850-41f9-b582-af4eec5efe34 deletion is rescheduled due to dependency. [ 1262.562427] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-012c551d-0850-41f9-b582-af4eec5efe34" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.597307] env[65427]: INFO networking_nsxv3.common.synchronization [req-a0c3a608-5f06-4a19-8e6b-ba31dc4f39b0 req-58599c11-7332-478b-ae44-319ec30108d1 tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1262.597996] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1262.598335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.598461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.598530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.598733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.598925] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.599072] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.599140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.599298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.599616] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.599616] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.102049] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.603591] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.106012] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.106439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.106439] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.106564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.106713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.106774] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be updated. [ 1264.137193] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.137446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.137446] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.137606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.137756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.147191] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 1266.162418] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 1266.162795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.599770] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.599770] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.600727] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.601075] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.210310] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.210726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.210726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.210726] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.210858] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.712940] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.216370] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.285258] env[65427]: INFO networking_nsxv3.common.synchronization [req-4f5d72b6-3d72-42e6-be4b-c2a67f519ec9 req-de0d0de7-6dae-4578-88ee-4fb4777036a2 tempest-ServerRescueTestJSON-1330040637 tempest-ServerRescueTestJSON-1330040637-project-member] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1275.285842] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1275.286170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.286304] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.286381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.286660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.286866] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.286982] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.287059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.287214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.287302] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.287397] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.607391] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-536 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.607574] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.607754] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.607942] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.608249] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.608410] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.608553] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.608839] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.608929] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.609209] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1275.609327] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1275.609435] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1275.609559] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1275.609670] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1275.609773] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1275.609908] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.630161] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.630341] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1275.630460] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.630625] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-536" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.631050] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-6df2405b-d472-4f43-9331-e2111e11e559 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.631231] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.631352] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.631669] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.631810] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df2405b-d472-4f43-9331-e2111e11e559',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.718649] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1275.718857] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1275.789269] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.134110] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.134465] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.134617] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.134993] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.135230] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.135442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Segment Port 6df2405b-d472-4f43-9331-e2111e11e559 not found, creating... [ 1276.135745] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.135975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.136171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.136447] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.136636] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.137016] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.137250] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.137417] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.137671] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.137858] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.138013] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 6df2405b-d472-4f43-9331-e2111e11e559 is going to be created. [ 1276.163536] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.163752] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.163880] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.164214] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.164452] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.164717] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.291508] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.526694] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.526897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.527010] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.527264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.541717] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1276.542735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.543354] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1276.579736] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.580568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.580568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.580568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.595189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.595987] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1276.596088] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.596185] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1276.635137] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.635279] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.635523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.635658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.637149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.637393] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1276.713514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.713722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.713798] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.714120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.714380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.714747] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1276.791029] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.791239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.791323] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.791547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.791885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.792171] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1276.792271] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'546f1ff4-ef91-4671-86b3-d15ea6055715', 'a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a', '1b517a9d-1965-4f62-ac9b-62dd080aea20', '1bdf134a-d29c-4b39-8d6f-906721fa578b', '7f6a6fc4-6042-426c-9f0e-146d4bed152c', '3403f3a9-6000-4b2c-afd8-65a85129fffb', 'a6ac5c0f-07e4-483f-9add-e9bd5d48447e', '07e38e11-5e71-4d2b-b175-0954d843dabf', 'afc0d389-bdfb-4be8-835d-7aa3fb82fdb5', '8b2d765d-91fb-4fe9-b7d0-06af18babd59', 'ee02d41e-1b45-4110-a181-67b0178ab29f', '7a2ecffa-d3a3-4a6a-92d0-e586342d36b4', 'bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5', '45c1be55-d441-4f27-a369-9d34ec40f623', 'efd36953-3031-481f-ae25-8e10517a449e', 'a9b48d05-4eaa-4bc3-a4df-b76973da2f83', '4c3613c9-fe90-4521-87ed-64503d04b3d5', '07731512-1a84-409c-8aa3-ceec6c6e184e', 'a66c3424-adb0-472b-bb3b-fbb14607817b', '3b945fd5-1333-4892-be63-1784a8a66349', '7abbe624-4b85-4277-bdd0-ed749e166fc9', '2c8bca44-f080-48fc-9d94-91ea357c71c7', '2f440566-de23-4d5d-b5b9-fdddf6cee691', '69f47490-5211-4c8e-9e0a-b7d44c25960f', '6e65cad1-7b76-434e-8bda-983c5b0b7e56', '92093753-0a5b-4859-8d42-30b3241d5251', '9f63122d-80d5-406e-9516-33dde99d684a', '2caa26d9-b324-42d2-886a-42215d3c4faf', 'c28844ee-3d37-4737-8b1e-d75a401be9a9', 'a4c70605-cf21-41b4-b935-773c9e9944e5', '974a55e0-fc07-407b-9d34-07e598ec3f15', '5de73072-1420-4348-9a8f-7aea1d3f3f89', 'e21c17b3-5a69-411a-ae70-4a3d9c8d81a8', 'e055f6e8-5bdf-4d73-ac15-366894643fcc', 'd569034b-409c-4fd2-a968-3cd540fb405e', 'ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b', '170e7804-bd59-4b8d-a494-3a73bf406102', 'f87de95f-23bb-4bc4-a0d9-8c1ba39407ad', '1a54a063-1f93-4072-9d9d-c355160cc6fd', '584eb45a-7106-4759-8924-ff61fcdd399f', '012c551d-0850-41f9-b582-af4eec5efe34', 'c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf', '0d451ec0-7db8-47cf-a4b7-45518e01097b', '511ffa69-7259-47ba-91d1-ab46e4d80bcc'} {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.792399] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1276.793544] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.793674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.793715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.793872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.793955] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.794053] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be updated. [ 1276.815437] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.815679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.815679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.815862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.815946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.816078] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1276.816152] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.816264] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1276.831227] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.831457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.831457] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.831641] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.831785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.841962] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1276.878548] env[65427]: INFO networking_nsxv3.common.synchronization [req-4f5d72b6-3d72-42e6-be4b-c2a67f519ec9 req-3dbbb349-0c79-40ff-b8e2-eebd2d4019f8 service nova] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_rules [ 1276.878779] env[65427]: INFO networking_nsxv3.common.synchronization [req-4f5d72b6-3d72-42e6-be4b-c2a67f519ec9 req-3dbbb349-0c79-40ff-b8e2-eebd2d4019f8 service nova] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1276.878922] env[65427]: INFO networking_nsxv3.common.synchronization [req-4f5d72b6-3d72-42e6-be4b-c2a67f519ec9 req-3dbbb349-0c79-40ff-b8e2-eebd2d4019f8 service nova] Enqueued Resource ID: 6df2405b-d472-4f43-9331-e2111e11e559 with Priority: HIGHEST for action port [ 1276.879482] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_rules [ 1276.879617] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1276.879729] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df2405b-d472-4f43-9331-e2111e11e559 with Priority: HIGHEST for action port [ 1276.880099] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.880246] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.880315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.880523] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.880603] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.881551] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.882514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.882514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df2405b-d472-4f43-9331-e2111e11e559 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.882514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.882514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.882514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.882514] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df2405b-d472-4f43-9331-e2111e11e559',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.914196] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.914407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.914462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.914686] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.915855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.916138] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1276.916217] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1276.916286] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1276.916353] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1276.916433] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1276.916506] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1276.916587] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGH for action security_group_rules [ 1276.916655] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGH for action security_group_rules [ 1276.916728] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 1276.916812] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGH for action security_group_rules [ 1276.916888] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGH for action security_group_rules [ 1276.916934] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGH for action security_group_rules [ 1276.916986] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGH for action security_group_rules [ 1276.917054] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGH for action security_group_rules [ 1276.917100] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGH for action security_group_rules [ 1276.917148] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGH for action security_group_rules [ 1276.917208] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGH for action security_group_rules [ 1276.917272] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGH for action security_group_rules [ 1276.917331] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGH for action security_group_rules [ 1276.917432] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGH for action security_group_rules [ 1276.917491] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGH for action security_group_rules [ 1276.917543] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGH for action security_group_rules [ 1276.917577] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGH for action security_group_rules [ 1276.917628] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGH for action security_group_rules [ 1276.917671] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGH for action security_group_rules [ 1276.917801] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.385063] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.385447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.385447] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6df2405b-d472-4f43-9331-e2111e11e559 with status ACTIVE [ 1277.385547] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.385603] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.385640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.385862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.385989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.386187] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.386321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.386357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.386494] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.386572] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.386790] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.386885] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.386947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.387102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.387189] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.387269] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6df2405b-d472-4f43-9331-e2111e11e559 is going to be updated. [ 1277.408498] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.408745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.408745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.408908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.409079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.409264] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df2405b-d472-4f43-9331-e2111e11e559" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.851813] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1278.852119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.852255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.852528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.852761] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.852924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.853148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.853269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.853317] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.853392] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.983141] env[65427]: INFO networking_nsxv3.common.synchronization [req-c316ba70-a1d2-40ff-8e19-c31c77cd4b54 req-085c5f51-103e-4ba8-a91c-caa1ff72b99a tempest-ServerActionsTestOtherA-1457677087 tempest-ServerActionsTestOtherA-1457677087-project-member] Enqueued Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1278.983689] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b with Priority: HIGHEST for action security_group_members [ 1278.983824] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1278.986947] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 with Priority: HIGH for action security_group_rules [ 1278.987140] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e with Priority: HIGH for action security_group_rules [ 1278.987256] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd36953-3031-481f-ae25-8e10517a449e with Priority: HIGH for action security_group_rules [ 1278.987359] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b945fd5-1333-4892-be63-1784a8a66349 with Priority: HIGH for action security_group_rules [ 1278.987456] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66c3424-adb0-472b-bb3b-fbb14607817b with Priority: HIGH for action security_group_rules [ 1278.987552] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07731512-1a84-409c-8aa3-ceec6c6e184e with Priority: HIGH for action security_group_rules [ 1278.987646] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 with Priority: HIGH for action security_group_rules [ 1278.987751] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c1be55-d441-4f27-a369-9d34ec40f623 with Priority: HIGH for action security_group_rules [ 1278.987869] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 with Priority: HIGH for action security_group_rules [ 1278.987963] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 with Priority: HIGH for action security_group_rules [ 1278.988065] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 with Priority: HIGH for action security_group_rules [ 1278.988156] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee02d41e-1b45-4110-a181-67b0178ab29f with Priority: HIGH for action security_group_rules [ 1278.988244] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 with Priority: HIGH for action security_group_rules [ 1278.988332] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 with Priority: HIGH for action security_group_rules [ 1278.988421] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb with Priority: HIGH for action security_group_rules [ 1278.988508] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e38e11-5e71-4d2b-b175-0954d843dabf with Priority: HIGH for action security_group_rules [ 1278.988594] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c with Priority: HIGH for action security_group_rules [ 1278.988680] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a with Priority: HIGH for action security_group_rules [ 1278.988767] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b with Priority: HIGH for action security_group_rules [ 1278.989086] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d451ec0-7db8-47cf-a4b7-45518e01097b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.989208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.989273] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.989464] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.989625] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.989727] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.989796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.989947] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.990051] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.990154] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d451ec0-7db8-47cf-a4b7-45518e01097b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.991073] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.991199] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.991265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.991426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.991503] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.992586] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b517a9d-1965-4f62-ac9b-62dd080aea20 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.992740] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.992812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.992963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.993196] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b517a9d-1965-4f62-ac9b-62dd080aea20',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.994180] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.995074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.995074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.995074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.995074] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6ac5c0f-07e4-483f-9add-e9bd5d48447e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.995807] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd36953-3031-481f-ae25-8e10517a449e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.995968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.996068] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.996221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.996299] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd36953-3031-481f-ae25-8e10517a449e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.997014] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b945fd5-1333-4892-be63-1784a8a66349 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.997126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.997193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.997343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.997417] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b945fd5-1333-4892-be63-1784a8a66349',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.998118] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66c3424-adb0-472b-bb3b-fbb14607817b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.998239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.998307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.998454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.998528] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66c3424-adb0-472b-bb3b-fbb14607817b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.001191] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07731512-1a84-409c-8aa3-ceec6c6e184e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.001191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.001191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.001365] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.001365] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07731512-1a84-409c-8aa3-ceec6c6e184e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.001973] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c3613c9-fe90-4521-87ed-64503d04b3d5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.002096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.002155] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.002353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.002397] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c3613c9-fe90-4521-87ed-64503d04b3d5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.003016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c1be55-d441-4f27-a369-9d34ec40f623 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.003126] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.003195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.003339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.003423] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c1be55-d441-4f27-a369-9d34ec40f623',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.004074] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.004182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.004249] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.004483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.004483] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b48d05-4eaa-4bc3-a4df-b76973da2f83',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.005123] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.005231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.005297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.005528] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.005528] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.006306] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.006412] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.006489] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.006948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.006948] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a2ecffa-d3a3-4a6a-92d0-e586342d36b4',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.007421] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee02d41e-1b45-4110-a181-67b0178ab29f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.007526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.007590] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.007738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.007838] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee02d41e-1b45-4110-a181-67b0178ab29f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.008519] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.008624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.008691] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.008878] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.008917] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b2d765d-91fb-4fe9-b7d0-06af18babd59',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.009805] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.009862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.009928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.010073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.010144] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afc0d389-bdfb-4be8-835d-7aa3fb82fdb5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.010898] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3403f3a9-6000-4b2c-afd8-65a85129fffb taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.011343] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.011431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.011579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.011933] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3403f3a9-6000-4b2c-afd8-65a85129fffb',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.013054] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07e38e11-5e71-4d2b-b175-0954d843dabf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.013448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.013733] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.014172] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.014335] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07e38e11-5e71-4d2b-b175-0954d843dabf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.015611] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.015812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.016260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.016601] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.016770] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f6a6fc4-6042-426c-9f0e-146d4bed152c',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.017809] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.017979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.018113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.018344] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.018462] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.019847] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdf134a-d29c-4b39-8d6f-906721fa578b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.019957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.019957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.020551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.020551] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdf134a-d29c-4b39-8d6f-906721fa578b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.026805] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.026998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.026998] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.027159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.048408] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.048553] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.049379] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.049490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.055551] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.055810] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.055889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.055927] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.056136] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.056221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.056315] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b is going to be updated. [ 1279.057555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.057793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.077792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.077983] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b517a9d-1965-4f62-ac9b-62dd080aea20 is going to be deleted. [ 1279.079413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.079625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.092825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.093050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.093050] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.093263] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.093395] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.096919] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.097318] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6ac5c0f-07e4-483f-9add-e9bd5d48447e is going to be deleted. [ 1279.105414] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: IN_PROGRESS for 2s [ 1279.146088] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.146308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.146308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.146544] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.146687] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.146917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b517a9d-1965-4f62-ac9b-62dd080aea20" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.151569] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.151720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.151765] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.151963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.152070] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.152225] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6ac5c0f-07e4-483f-9add-e9bd5d48447e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.356695] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.523728] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.523938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.523938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.524173] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.524348] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.524452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.524519] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.524717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.524835] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.524939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.525062] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.581094] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.581260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.581301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.581504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.583236] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.583387] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.602536] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.602793] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.603509] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.603617] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.604366] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.604505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.605217] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.605346] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.608559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.608656] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.609447] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.609584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.610248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.610339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.611048] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.611144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.611821] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.611917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.612617] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.613051] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.613140] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.613810] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.614230] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.614366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.615011] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.615416] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.615509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.616090] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.616487] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.616581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.617310] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.617795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.617931] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c3613c9-fe90-4521-87ed-64503d04b3d5 is going to be deleted. [ 1279.618858] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.619105] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.620522] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.620622] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.623401] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.623548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.639764] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.640347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.640478] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee02d41e-1b45-4110-a181-67b0178ab29f is going to be deleted. [ 1279.641398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.641606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.659552] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.659724] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd36953-3031-481f-ae25-8e10517a449e is going to be deleted. [ 1279.660584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.660817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.680692] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.680903] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b48d05-4eaa-4bc3-a4df-b76973da2f83 is going to be deleted. [ 1279.681787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.682069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.685177] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.685316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.694540] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.694862] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.708332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.708567] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3403f3a9-6000-4b2c-afd8-65a85129fffb is going to be deleted. [ 1279.709505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.709732] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.717431] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.717680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.740195] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.740355] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f6a6fc4-6042-426c-9f0e-146d4bed152c is going to be deleted. [ 1279.741239] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.741454] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.746574] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.746739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.767461] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.767625] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07731512-1a84-409c-8aa3-ceec6c6e184e is going to be deleted. [ 1279.768550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.768772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.843133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.843312] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b945fd5-1333-4892-be63-1784a8a66349 is going to be deleted. [ 1279.844256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.844482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.849225] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.849393] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.856978] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.857296] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.858472] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.898625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.898810] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66c3424-adb0-472b-bb3b-fbb14607817b is going to be deleted. [ 1279.899743] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.899972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.902441] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.902581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.944766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.944931] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b2d765d-91fb-4fe9-b7d0-06af18babd59 is going to be deleted. [ 1279.945831] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.946061] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.007181] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.007407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.012219] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.012366] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afc0d389-bdfb-4be8-835d-7aa3fb82fdb5 is going to be deleted. [ 1280.013256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.013486] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.028736] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.041721] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.041954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.062156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.062326] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c1be55-d441-4f27-a369-9d34ec40f623 is going to be deleted. [ 1280.063306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.063565] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.080257] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.081310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.115708] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.115847] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5 is going to be deleted. [ 1280.116796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.117026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.189812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.190032] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a is going to be deleted. [ 1280.190985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.191232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.198454] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.198631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.209876] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.210071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.264400] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.264680] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a2ecffa-d3a3-4a6a-92d0-e586342d36b4 is going to be deleted. [ 1280.265484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.265717] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.318426] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.318633] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07e38e11-5e71-4d2b-b175-0954d843dabf is going to be deleted. [ 1280.319550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.319773] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.360782] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.361032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.361032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.361207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.361278] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.361378] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be updated. [ 1280.375504] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.375722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.378248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.378431] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdf134a-d29c-4b39-8d6f-906721fa578b is going to be deleted. [ 1280.379728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.380032] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.380141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.380271] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c3613c9-fe90-4521-87ed-64503d04b3d5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.380468] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.380667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.380757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.380941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee02d41e-1b45-4110-a181-67b0178ab29f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.381608] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.381834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.381949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382103] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd36953-3031-481f-ae25-8e10517a449e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382251] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.382407] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.382488] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b48d05-4eaa-4bc3-a4df-b76973da2f83" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382744] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.382890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.382967] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.383097] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3403f3a9-6000-4b2c-afd8-65a85129fffb" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.383227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.383368] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.383444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.383556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f6a6fc4-6042-426c-9f0e-146d4bed152c" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.383683] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.383825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.383901] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.384025] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07731512-1a84-409c-8aa3-ceec6c6e184e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.384157] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.384297] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.384370] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.384480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b945fd5-1333-4892-be63-1784a8a66349" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.384639] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.384823] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.384904] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385031] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66c3424-adb0-472b-bb3b-fbb14607817b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385166] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.385307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.385380] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b2d765d-91fb-4fe9-b7d0-06af18babd59" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.385749] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.385825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385944] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c1be55-d441-4f27-a369-9d34ec40f623" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.386079] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.386217] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.386289] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.386399] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afc0d389-bdfb-4be8-835d-7aa3fb82fdb5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.386529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.386667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.386791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.386924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd7e968a-b7cb-4d5e-b951-dce9cd8eeda5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.388078] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.388207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.388286] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.388421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.388498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.388613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e49a2c-f4a7-4eb9-b5d2-7ef060fdf07a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.416921] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.417162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.417162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.417377] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.417524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.419263] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.419409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.419451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.419609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.419695] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.419811] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07e38e11-5e71-4d2b-b175-0954d843dabf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.443536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1280.444345] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.444478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.444548] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.444781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.444879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.445013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a2ecffa-d3a3-4a6a-92d0-e586342d36b4" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.460947] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1280.461579] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.461738] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.461867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.462131] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.462228] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.462353] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdf134a-d29c-4b39-8d6f-906721fa578b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.530887] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546f1ff4-ef91-4671-86b3-d15ea6055715: rpc.has_security_group_logging(os_id): False [ 1280.554162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.554406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.554406] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.554591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.576483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.576855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.576986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.577071] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.577274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.577356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.577445] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1280.643428] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.643592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.643666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.643876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.644034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.661017] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1281.117845] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b in Status: SUCCESS [ 1281.118298] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d451ec0-7db8-47cf-a4b7-45518e01097b deletion is rescheduled due to dependency. [ 1281.118298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d451ec0-7db8-47cf-a4b7-45518e01097b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.454315] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1282.454679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.454917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.455181] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.455382] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.455502] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.455568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.455725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.455810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.455898] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.456017] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.674527] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1282.674766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.958559] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.958794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.958794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.958962] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.959160] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.959268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.959336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.959495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.959585] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.959678] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.959830] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.959928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.959993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.960149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.960293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.960390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.960477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.960626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.960704] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.960791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.960886] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.464647] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92093753-0a5b-4859-8d42-30b3241d5251: rpc.has_security_group_logging(os_id): False [ 1283.482691] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.482852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.482957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.483169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.508144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.508430] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.508972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.508972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.508972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.508972] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.509182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.509272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.509332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.509478] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.509604] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.509727] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.509836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.509875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.510033] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.510125] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.510176] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be updated. [ 1283.567111] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.567240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.567299] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.567511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.567725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.583646] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1283.990426] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.990591] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1285.600089] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1285.600509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.450338] env[65427]: INFO networking_nsxv3.common.synchronization [req-cd720dfd-1ac1-41a5-95fe-4d81d16762b0 req-4fc4673e-a9a3-4db9-aecc-0fd39bc50d8e tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1287.450871] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1287.451199] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.451362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.451362] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.451561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.452301] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.452301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.452301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.452301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.452301] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.452568] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.955450] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.955625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.955625] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.955948] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.956089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.956340] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.956444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.956538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.956710] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.956855] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.957012] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1287.984025] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.984247] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.984332] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.984532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.984720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.992730] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1290.004321] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1290.004655] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 deletion is rescheduled due to dependency. [ 1290.004655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.452322] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.452703] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.548882] env[65427]: INFO networking_nsxv3.common.synchronization [req-25d1a41f-4419-4f1d-8333-6df1e4602ffe req-3cde3162-e78f-4ee1-b455-f67f3d4f73c5 tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1294.549383] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1294.549746] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.549817] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.549880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.550089] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.550258] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.550374] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.550659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.550659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.550659] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.550808] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.837083] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.837297] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.837417] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.837693] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.837948] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.838122] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.838266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.838460] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.838598] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.838819] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.838932] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.839058] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.839200] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.839303] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.839407] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.839536] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.859753] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.859942] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1294.860060] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.860240] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-558" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.860615] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-19ead438-156e-478a-b7ef-eaecc810f4f5 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.860790] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.860909] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.861257] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.861450] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19ead438-156e-478a-b7ef-eaecc810f4f5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.056627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.056881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.056881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.057159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.057257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.057472] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.057581] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.057648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.057816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.057916] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.058065] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1295.083453] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.083681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.083681] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.083849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.083990] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.092952] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1295.363683] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.364127] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.364127] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.364391] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.364505] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.364680] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 19ead438-156e-478a-b7ef-eaecc810f4f5 not found, creating... [ 1295.364971] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.365187] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.365349] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.365548] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.366188] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.366188] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.366188] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.366450] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.366507] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.366684] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.366765] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 19ead438-156e-478a-b7ef-eaecc810f4f5 is going to be created. [ 1295.387039] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.387356] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.387467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.387644] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.387890] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.388166] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.068102] env[65427]: INFO networking_nsxv3.common.synchronization [req-25d1a41f-4419-4f1d-8333-6df1e4602ffe req-50ca24f8-ee28-484b-9ef8-dc3797c54e19 service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 1296.068398] env[65427]: INFO networking_nsxv3.common.synchronization [req-25d1a41f-4419-4f1d-8333-6df1e4602ffe req-50ca24f8-ee28-484b-9ef8-dc3797c54e19 service nova] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1296.068546] env[65427]: INFO networking_nsxv3.common.synchronization [req-25d1a41f-4419-4f1d-8333-6df1e4602ffe req-50ca24f8-ee28-484b-9ef8-dc3797c54e19 service nova] Enqueued Resource ID: 19ead438-156e-478a-b7ef-eaecc810f4f5 with Priority: HIGHEST for action port [ 1296.068953] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_rules [ 1296.069111] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1296.069214] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19ead438-156e-478a-b7ef-eaecc810f4f5 with Priority: HIGHEST for action port [ 1296.069534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.069613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.069677] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.069875] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.069952] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.070855] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.071020] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.071234] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-19ead438-156e-478a-b7ef-eaecc810f4f5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.071429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.071429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.071561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.071613] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19ead438-156e-478a-b7ef-eaecc810f4f5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.573316] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.573534] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.573757] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19ead438-156e-478a-b7ef-eaecc810f4f5 with status ACTIVE [ 1296.574016] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.574162] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.574258] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.574506] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.574624] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.574835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.574969] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.575076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.575284] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.575390] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.575624] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.575771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.575865] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.576059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.576179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.576297] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19ead438-156e-478a-b7ef-eaecc810f4f5 is going to be updated. [ 1296.598646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.598917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.598917] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.599124] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.599232] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.599597] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19ead438-156e-478a-b7ef-eaecc810f4f5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.102813] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1297.103205] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 deletion is rescheduled due to dependency. [ 1297.103205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.103290] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.103463] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.103646] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.103760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.103825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.103999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.104101] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.104196] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.606570] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.109744] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.612595] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.612766] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.612874] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.613169] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.613295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613428] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1298.645635] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.645791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.645866] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.646116] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.646267] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.655186] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1298.882413] env[65427]: INFO networking_nsxv3.common.synchronization [req-4a011970-dcf5-4862-b26e-6f484b012a17 req-254192e6-3cff-4d31-bbc6-7fc59401d39f tempest-ServerRescueTestJSON-1330040637 tempest-ServerRescueTestJSON-1330040637-project-member] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1298.882965] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1298.883287] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.883408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.883477] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.883841] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.883841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.883954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.884019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.884129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.884216] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.884439] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.386099] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.888442] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.390987] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.391421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.391421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.391503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.391554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.391671] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be updated. [ 1300.428339] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.428556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.428556] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.428754] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.428897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.438891] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1300.666222] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1300.666404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.666620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.666941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.667171] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.667341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.667417] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.667584] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.667670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.667757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.667851] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.169769] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.672442] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546f1ff4-ef91-4671-86b3-d15ea6055715: rpc.has_security_group_logging(os_id): False [ 1301.690239] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.690469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.690469] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.690663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.690752] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.691019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.691127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.691191] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.691337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.691415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.691501] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1301.749463] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.749698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.749698] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.749833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.749981] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.766775] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1302.461756] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1302.461756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.784375] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1303.784785] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.884197] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.884380] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.518575] env[65427]: INFO networking_nsxv3.common.synchronization [req-74c47cb3-2cfd-4009-8859-d7a7403c3c6e req-ed817115-0dd8-4bf8-be9f-b7f15ca2bc66 tempest-ServerRescueTestJSON-1330040637 tempest-ServerRescueTestJSON-1330040637-project-member] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1305.519358] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGHEST for action security_group_members [ 1305.519869] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.520052] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.520156] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.520431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.520650] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.520795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.520892] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.521120] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.521245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.521397] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.023448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.023672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.023725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.023974] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.024084] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.024293] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.024394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.024476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.024685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.024771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.024862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be updated. [ 1306.053828] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.054067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.054067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.054256] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.054409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.066275] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: IN_PROGRESS for 2s [ 1308.077809] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92093753-0a5b-4859-8d42-30b3241d5251 in Status: SUCCESS [ 1308.078259] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 deletion is rescheduled due to dependency. [ 1308.078259] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.520400] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.520775] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.521447] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.521883] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.522610] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.522994] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.524302] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.524302] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.524771] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.525172] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.525829] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.526361] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.527490] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.527925] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.528803] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.529220] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.529574] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.529971] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.531306] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.531724] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.325941] env[65427]: INFO networking_nsxv3.common.synchronization [req-f8eb4373-1673-4fed-8072-61a0d45175b5 req-1372ebf6-b386-400d-a799-1398c35ae32d tempest-ServerActionsTestJSON-1731871962 tempest-ServerActionsTestJSON-1731871962-project-member] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1357.326418] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGHEST for action security_group_members [ 1357.326755] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.326879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.327117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.327174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.327335] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.327452] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.327508] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.327673] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.327761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.327849] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.830030] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.830257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.830257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.830500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.830500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.830697] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.830816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.830879] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.830993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.831078] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.831166] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be updated. [ 1357.858739] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.859028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.859028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.859276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.859448] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.874055] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: IN_PROGRESS for 2s [ 1359.885751] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 in Status: SUCCESS [ 1359.886164] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 deletion is rescheduled due to dependency. [ 1359.886164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.328029] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.328510] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.898488] env[65427]: INFO networking_nsxv3.common.synchronization [None req-729b620a-d9fc-4952-9096-8d1cf42de9c7 None None] Enqueued Resource ID: 7dc371af-9ee4-4fcb-8ef1-126d2eb492a2 with Priority: HIGHEST for action port [ 1366.899080] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc371af-9ee4-4fcb-8ef1-126d2eb492a2 with Priority: HIGHEST for action port [ 1366.899555] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dc371af-9ee4-4fcb-8ef1-126d2eb492a2 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.899555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dc371af-9ee4-4fcb-8ef1-126d2eb492a2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.899555] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dc371af-9ee4-4fcb-8ef1-126d2eb492a2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.899812] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dc371af-9ee4-4fcb-8ef1-126d2eb492a2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.899896] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dc371af-9ee4-4fcb-8ef1-126d2eb492a2',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.276098] env[65427]: INFO networking_nsxv3.common.synchronization [None req-38136b83-34f5-4c37-8e3c-54426487786e tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1367.276799] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1367.277501] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.277679] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.277774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.278046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.278140] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.360228] env[65427]: INFO networking_nsxv3.common.synchronization [None req-983589f1-c28b-43ea-8b07-f5b8e96e76a5 tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1367.360551] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1367.360699] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.360794] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.403321] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dc371af-9ee4-4fcb-8ef1-126d2eb492a2 [ 1367.403514] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.403697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.403791] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.404060] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.404165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.404265] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dc371af-9ee4-4fcb-8ef1-126d2eb492a2 already deleted. [ 1367.404350] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dc371af-9ee4-4fcb-8ef1-126d2eb492a2" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.800537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.800750] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.800846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.801113] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.801174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.801277] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 already deleted. [ 1367.801361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.801546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.801714] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.801817] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.322395] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.322770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.322770] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.322949] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.323053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.323150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 already deleted. [ 1368.323236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.739097] env[65427]: INFO networking_nsxv3.common.synchronization [None req-4df17388-6218-42f7-ab84-6eaccee66ccf None None] Enqueued Resource ID: 1f39954d-daff-4c75-a929-c46269f4cbe1 with Priority: HIGHEST for action port [ 1368.739673] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f39954d-daff-4c75-a929-c46269f4cbe1 with Priority: HIGHEST for action port [ 1368.739988] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f39954d-daff-4c75-a929-c46269f4cbe1 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.740127] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f39954d-daff-4c75-a929-c46269f4cbe1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.740193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f39954d-daff-4c75-a929-c46269f4cbe1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.740444] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f39954d-daff-4c75-a929-c46269f4cbe1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.740520] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f39954d-daff-4c75-a929-c46269f4cbe1',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.243055] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f39954d-daff-4c75-a929-c46269f4cbe1 [ 1369.243260] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.243408] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.243471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.243701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.243760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.243848] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f39954d-daff-4c75-a929-c46269f4cbe1 already deleted. [ 1369.244028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f39954d-daff-4c75-a929-c46269f4cbe1" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.641570] env[65427]: INFO networking_nsxv3.common.synchronization [req-1ac979e1-e3e9-4d13-8a94-7a2c15fbc4e2 req-fc3f500f-ca6b-4462-b320-293578d6be15 tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1372.642152] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1372.642433] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.642559] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.642628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.642872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.643046] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.643161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.643202] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.643352] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.643504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.643606] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.896040] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.896228] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.896340] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.896675] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.896944] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.897119] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.897237] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.897483] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.897631] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.897873] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1372.897994] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1372.898119] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1372.898228] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1372.898368] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1372.898484] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1372.898617] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1372.921770] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1372.921948] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1372.922091] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1372.922277] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.922604] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-4eca052d-3dee-4b6f-8d00-37750ab6ab58 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.922778] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.922899] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.923258] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.923402] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eca052d-3dee-4b6f-8d00-37750ab6ab58',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.145924] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.146160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.146160] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.146388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.146510] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.146732] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.146836] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.146887] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.147069] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.147150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.147234] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 already deleted. [ 1373.147347] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.426123] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.426502] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.426502] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.426755] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.426906] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.427070] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 4eca052d-3dee-4b6f-8d00-37750ab6ab58 not found, creating... [ 1373.427356] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.427525] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.427643] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.427868] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.428013] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.428309] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.428477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.428596] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.428800] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.428936] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.429094] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 4eca052d-3dee-4b6f-8d00-37750ab6ab58 is going to be created. [ 1373.450406] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.450750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.450750] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.450962] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.451213] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.451437] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.133264] env[65427]: INFO networking_nsxv3.common.synchronization [req-1ac979e1-e3e9-4d13-8a94-7a2c15fbc4e2 req-315b1c3a-1a8e-4db3-b3f2-59dc8b4d9d5a service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1374.133551] env[65427]: INFO networking_nsxv3.common.synchronization [req-1ac979e1-e3e9-4d13-8a94-7a2c15fbc4e2 req-315b1c3a-1a8e-4db3-b3f2-59dc8b4d9d5a service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1374.133713] env[65427]: INFO networking_nsxv3.common.synchronization [req-1ac979e1-e3e9-4d13-8a94-7a2c15fbc4e2 req-315b1c3a-1a8e-4db3-b3f2-59dc8b4d9d5a service nova] Enqueued Resource ID: 4eca052d-3dee-4b6f-8d00-37750ab6ab58 with Priority: HIGHEST for action port [ 1374.134270] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1374.134442] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1374.134501] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eca052d-3dee-4b6f-8d00-37750ab6ab58 with Priority: HIGHEST for action port [ 1374.135276] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.135424] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.135500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.135703] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.135789] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.136670] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.136780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.136880] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.137028] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.137178] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.137298] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.137388] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.137569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.137569] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.137703] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.138363] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eca052d-3dee-4b6f-8d00-37750ab6ab58 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.138490] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.138549] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.138845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.138845] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eca052d-3dee-4b6f-8d00-37750ab6ab58',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.640714] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.640852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.641095] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.641994] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eca052d-3dee-4b6f-8d00-37750ab6ab58 with status ACTIVE [ 1374.642192] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.642308] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.642375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.642643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.642771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.642906] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.643018] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.643083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.644164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.644164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.644164] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.644164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.644164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.644164] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.644607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.644607] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eca052d-3dee-4b6f-8d00-37750ab6ab58 is going to be updated. [ 1374.664844] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.665087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.665204] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.665445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.665609] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.665772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eca052d-3dee-4b6f-8d00-37750ab6ab58" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.146011] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.648582] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.648787] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.648838] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.649039] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.649133] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.649233] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be created. [ 1375.674233] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.674465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.674465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.674582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.674724] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.684480] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: UNINITIALIZED for 2s [ 1377.695476] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1377.695857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.695857] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.696077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.696278] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.696394] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.696449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.696612] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.696694] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.696780] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.696868] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.199050] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.701968] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9bc56a-e8fc-4868-ba33-8748f21e2376: rpc.has_security_group_logging(os_id): False [ 1378.719351] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.719546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.719596] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.719816] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.719912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.720219] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.720322] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.720384] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.720539] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.720619] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.720706] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be created. [ 1378.779730] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.779986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.779986] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.780154] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.780335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.792303] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1379.136101] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.136314] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1380.807059] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1380.807059] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.137413] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.137890] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.138337] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.138815] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.140083] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.140083] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.140650] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.141095] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.141771] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.142306] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.143289] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.143776] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.143996] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.144485] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.144979] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.145468] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.146341] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.146752] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.147900] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.147900] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.148659] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.149065] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.149726] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.150243] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.151606] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.152050] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.152685] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.153041] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.153903] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.154219] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.154802] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.155224] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.157032] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.157032] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.157921] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.158333] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.159161] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.159565] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.160057] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.160445] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.161594] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.161956] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.273336] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1487.273336] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:4 started [ 1489.162911] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.163357] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.164865] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.165261] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.165920] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.166329] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.320205] env[65427]: INFO networking_nsxv3.common.synchronization [req-84b66b8b-94ed-477e-afd4-2969102fd685 req-b057b69b-e175-4a69-8e03-faf17741f4e3 tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1499.320789] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1499.321119] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.321741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.321741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.321741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.321741] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.321741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.321971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.321971] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.322110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.322181] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.824106] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.824321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.824321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.824503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.824591] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.824805] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.824888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.824954] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.825114] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.825193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.825279] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1499.860896] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.861144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.861144] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.861401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.861615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.870408] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1501.882014] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1501.882363] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 deletion is rescheduled due to dependency. [ 1501.882363] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.321501] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.321895] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.692576] env[65427]: INFO networking_nsxv3.common.synchronization [req-be5ac58e-35af-46f2-899e-a05d341d221c req-ee5ce029-ae33-4c25-945c-9596860da597 tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1507.693179] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1507.693524] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.693672] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.693751] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.693950] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.696130] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.696255] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.696321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.696498] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.696607] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.696703] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.981623] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.981825] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.981951] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.982246] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.982513] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.982675] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.982793] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.983012] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.983165] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.983393] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.983505] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1507.983615] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1507.983724] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1507.983834] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.983939] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1507.984082] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1508.003911] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1508.004093] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1508.004219] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1508.004393] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.004687] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-20aac7e5-0d08-48b0-8134-974ad06ff5aa taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.004852] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.004970] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.005306] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.005450] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aac7e5-0d08-48b0-8134-974ad06ff5aa',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.198580] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.198786] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.198868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.199262] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.199367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.199613] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.199747] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.199834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.200035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.200147] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.200261] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1508.223841] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.224034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.224034] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.224333] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.224514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.232929] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1508.508168] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.508425] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.508549] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.508828] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.508980] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.509172] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 20aac7e5-0d08-48b0-8134-974ad06ff5aa not found, creating... [ 1508.509439] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.509594] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.509711] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.509935] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.510088] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.510370] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.510536] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.510647] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.510853] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.510987] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.511138] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 20aac7e5-0d08-48b0-8134-974ad06ff5aa is going to be created. [ 1508.533086] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.533319] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.533424] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.533707] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.533931] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.534169] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.233670] env[65427]: INFO networking_nsxv3.common.synchronization [req-be5ac58e-35af-46f2-899e-a05d341d221c req-77934f0e-3410-4806-89ff-773afa949c0b service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1509.233938] env[65427]: INFO networking_nsxv3.common.synchronization [req-be5ac58e-35af-46f2-899e-a05d341d221c req-77934f0e-3410-4806-89ff-773afa949c0b service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1509.234047] env[65427]: INFO networking_nsxv3.common.synchronization [req-be5ac58e-35af-46f2-899e-a05d341d221c req-77934f0e-3410-4806-89ff-773afa949c0b service nova] Enqueued Resource ID: 20aac7e5-0d08-48b0-8134-974ad06ff5aa with Priority: HIGHEST for action port [ 1509.234550] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1509.234696] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1509.234886] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20aac7e5-0d08-48b0-8134-974ad06ff5aa with Priority: HIGHEST for action port [ 1509.235654] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.236053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.236208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.236409] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.236564] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.237396] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.237497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.237749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-20aac7e5-0d08-48b0-8134-974ad06ff5aa taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.237821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.237881] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.238057] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.238311] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aac7e5-0d08-48b0-8134-974ad06ff5aa',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.739679] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.739826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.740031] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20aac7e5-0d08-48b0-8134-974ad06ff5aa with status ACTIVE [ 1509.740248] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.740306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.740414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.740606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.740701] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.740876] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.740970] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.741046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.741209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.741285] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.741466] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.741558] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.741618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.741761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.741834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.741918] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20aac7e5-0d08-48b0-8134-974ad06ff5aa is going to be updated. [ 1509.762508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.762705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.762705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.762896] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.763046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.763253] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20aac7e5-0d08-48b0-8134-974ad06ff5aa" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.243088] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1510.243369] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 deletion is rescheduled due to dependency. [ 1510.243411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.243554] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.243774] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.243965] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.244095] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.244159] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.244316] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.244398] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.244505] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.748734] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.251025] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.754322] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.754470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.754470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.754660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.754830] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.755416] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1511.786045] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.786459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.786459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.787138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.787138] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.795562] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1513.806559] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1513.806912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.806912] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.807110] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.807305] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.807415] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.807483] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.807638] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.807721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.807806] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.807895] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.209160] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.209418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.209418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.209640] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.209751] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.235493] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.235656] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1514.310395] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.712130] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.813206] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9bc56a-e8fc-4868-ba33-8748f21e2376: rpc.has_security_group_logging(os_id): False [ 1514.830516] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.830783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.830783] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.830941] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.831043] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.831286] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.831381] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.831443] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.831602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.831674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.831754] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1514.886184] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.886445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.886445] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.886530] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.886685] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.897697] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1515.214614] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.717185] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1515.717386] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1516.476645] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.476975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.476975] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.477141] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.490060] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1516.490932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.491972] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1516.535100] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.535355] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.535437] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.535594] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.550405] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.551257] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1516.551399] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.552067] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1516.586376] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.586631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.586939] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.587077] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.588035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.588265] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1516.662508] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.662729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.662729] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.662973] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.663328] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.663559] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1516.734835] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.735029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.735029] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.735227] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.735511] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.735785] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1516.735873] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'546f1ff4-ef91-4671-86b3-d15ea6055715', '7abbe624-4b85-4277-bdd0-ed749e166fc9', '2c8bca44-f080-48fc-9d94-91ea357c71c7', '2f440566-de23-4d5d-b5b9-fdddf6cee691', '69f47490-5211-4c8e-9e0a-b7d44c25960f', '6e65cad1-7b76-434e-8bda-983c5b0b7e56', '92093753-0a5b-4859-8d42-30b3241d5251', '9f63122d-80d5-406e-9516-33dde99d684a', '2caa26d9-b324-42d2-886a-42215d3c4faf', 'c28844ee-3d37-4737-8b1e-d75a401be9a9', 'a4c70605-cf21-41b4-b935-773c9e9944e5', '974a55e0-fc07-407b-9d34-07e598ec3f15', '5de73072-1420-4348-9a8f-7aea1d3f3f89', 'e21c17b3-5a69-411a-ae70-4a3d9c8d81a8', 'e055f6e8-5bdf-4d73-ac15-366894643fcc', '9a9bc56a-e8fc-4868-ba33-8748f21e2376', 'd569034b-409c-4fd2-a968-3cd540fb405e', 'ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b', '170e7804-bd59-4b8d-a494-3a73bf406102', 'f87de95f-23bb-4bc4-a0d9-8c1ba39407ad', '1a54a063-1f93-4072-9d9d-c355160cc6fd', '012c551d-0850-41f9-b582-af4eec5efe34', 'c114b7b2-62ba-4c36-97b4-9adfa3b7ebcf', '0d451ec0-7db8-47cf-a4b7-45518e01097b', '584eb45a-7106-4759-8924-ff61fcdd399f', '511ffa69-7259-47ba-91d1-ab46e4d80bcc'} {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.735986] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1516.754077] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.754335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.754335] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.754465] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.754550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.754661] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1516.754734] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.754802] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1516.831304] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.831532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.831532] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.831735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.832976] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.833237] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1516.833319] env[65427]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65427) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1516.833394] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1516.833462] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1516.833542] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1516.833612] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1516.833706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGH for action security_group_rules [ 1516.833774] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGH for action security_group_rules [ 1516.833834] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGH for action security_group_rules [ 1516.833898] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGH for action security_group_rules [ 1516.833955] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGH for action security_group_rules [ 1516.834031] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGH for action security_group_rules [ 1516.834098] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGH for action security_group_rules [ 1516.834178] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGH for action security_group_rules [ 1516.834250] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGH for action security_group_rules [ 1516.834305] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGH for action security_group_rules [ 1516.834360] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGH for action security_group_rules [ 1516.834418] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGH for action security_group_rules [ 1516.834476] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGH for action security_group_rules [ 1516.834541] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGH for action security_group_rules [ 1516.834599] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGH for action security_group_rules [ 1516.834656] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGH for action security_group_rules [ 1516.834715] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGH for action security_group_rules [ 1516.834784] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGH for action security_group_rules [ 1516.834826] env[65427]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGH for action security_group_rules [ 1516.834924] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.910852] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1516.911096] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.236337] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.236706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1519.236706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 with Priority: HIGH for action security_group_rules [ 1519.236706] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 with Priority: HIGH for action security_group_rules [ 1519.236822] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92093753-0a5b-4859-8d42-30b3241d5251 with Priority: HIGH for action security_group_rules [ 1519.236856] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e055f6e8-5bdf-4d73-ac15-366894643fcc with Priority: HIGH for action security_group_rules [ 1519.236971] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad with Priority: HIGH for action security_group_rules [ 1519.237061] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 170e7804-bd59-4b8d-a494-3a73bf406102 with Priority: HIGH for action security_group_rules [ 1519.237149] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b with Priority: HIGH for action security_group_rules [ 1519.237244] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d569034b-409c-4fd2-a968-3cd540fb405e with Priority: HIGH for action security_group_rules [ 1519.237340] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 with Priority: HIGH for action security_group_rules [ 1519.237433] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGH for action security_group_rules [ 1519.237525] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 with Priority: HIGH for action security_group_rules [ 1519.237617] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 with Priority: HIGH for action security_group_rules [ 1519.237709] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4c70605-cf21-41b4-b935-773c9e9944e5 with Priority: HIGH for action security_group_rules [ 1519.237800] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 with Priority: HIGH for action security_group_rules [ 1519.237890] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2caa26d9-b324-42d2-886a-42215d3c4faf with Priority: HIGH for action security_group_rules [ 1519.237980] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 with Priority: HIGH for action security_group_rules [ 1519.238086] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f63122d-80d5-406e-9516-33dde99d684a with Priority: HIGH for action security_group_rules [ 1519.238218] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f with Priority: HIGH for action security_group_rules [ 1519.238316] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 with Priority: HIGH for action security_group_rules [ 1519.238406] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 with Priority: HIGH for action security_group_rules [ 1519.238758] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546f1ff4-ef91-4671-86b3-d15ea6055715 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.238893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.238957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.239193] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.239282] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546f1ff4-ef91-4671-86b3-d15ea6055715',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.240285] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c8bca44-f080-48fc-9d94-91ea357c71c7 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.240404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.240473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.240637] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.240715] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c8bca44-f080-48fc-9d94-91ea357c71c7',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.241545] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92093753-0a5b-4859-8d42-30b3241d5251 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.241658] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.241725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.241876] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.241953] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92093753-0a5b-4859-8d42-30b3241d5251',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.242642] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e055f6e8-5bdf-4d73-ac15-366894643fcc taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.242934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.243016] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.243174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.243250] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e055f6e8-5bdf-4d73-ac15-366894643fcc',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.243931] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.244058] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.244128] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.244277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.244355] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f87de95f-23bb-4bc4-a0d9-8c1ba39407ad',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.245017] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-170e7804-bd59-4b8d-a494-3a73bf406102 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.245130] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.245283] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.245435] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.245551] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('170e7804-bd59-4b8d-a494-3a73bf406102',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.246254] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.246361] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.246429] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.246579] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.246653] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.247336] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d569034b-409c-4fd2-a968-3cd540fb405e taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.247441] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.247507] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.247665] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.247738] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d569034b-409c-4fd2-a968-3cd540fb405e',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.250162] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.250274] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.250329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.250482] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.250558] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e21c17b3-5a69-411a-ae70-4a3d9c8d81a8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.251238] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.251348] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.251414] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.251561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.251676] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.252320] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de73072-1420-4348-9a8f-7aea1d3f3f89 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.252430] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.252495] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.252644] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.252716] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de73072-1420-4348-9a8f-7aea1d3f3f89',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.253391] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974a55e0-fc07-407b-9d34-07e598ec3f15 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.253550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.253550] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.253699] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.253773] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974a55e0-fc07-407b-9d34-07e598ec3f15',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.254545] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4c70605-cf21-41b4-b935-773c9e9944e5 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.254654] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.254713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.254868] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.254940] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4c70605-cf21-41b4-b935-773c9e9944e5',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.255627] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c28844ee-3d37-4737-8b1e-d75a401be9a9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.255734] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.255818] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.255963] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.256084] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c28844ee-3d37-4737-8b1e-d75a401be9a9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.256749] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2caa26d9-b324-42d2-886a-42215d3c4faf taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.256890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.256890] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.257082] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.257146] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2caa26d9-b324-42d2-886a-42215d3c4faf',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.257908] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.258044] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.258117] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.258291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.258363] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e65cad1-7b76-434e-8bda-983c5b0b7e56',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.259036] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f63122d-80d5-406e-9516-33dde99d684a taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.259174] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.259207] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.259349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.259425] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f63122d-80d5-406e-9516-33dde99d684a',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.260182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f47490-5211-4c8e-9e0a-b7d44c25960f taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.260182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.260349] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.260396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.260436] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f47490-5211-4c8e-9e0a-b7d44c25960f',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.261119] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7abbe624-4b85-4277-bdd0-ed749e166fc9 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.261240] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.261307] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.261455] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.261529] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7abbe624-4b85-4277-bdd0-ed749e166fc9',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.262296] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f440566-de23-4d5d-b5b9-fdddf6cee691 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.262404] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.262470] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.262615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.262687] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f440566-de23-4d5d-b5b9-fdddf6cee691',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.313365] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.313602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.313602] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.313781] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.315796] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.315932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.316668] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.316755] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.317399] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.317497] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.318263] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.318357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.319360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.319456] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.320160] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.320275] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.333505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.333641] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e055f6e8-5bdf-4d73-ac15-366894643fcc is going to be deleted. [ 1519.334447] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.334648] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.353026] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.353228] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d569034b-409c-4fd2-a968-3cd540fb405e is going to be deleted. [ 1519.354143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.354356] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.372895] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.373081] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f87de95f-23bb-4bc4-a0d9-8c1ba39407ad is going to be deleted. [ 1519.373889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.374129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.386788] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.387013] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.403149] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.403326] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546f1ff4-ef91-4671-86b3-d15ea6055715 is going to be deleted. [ 1519.404277] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.404509] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.418448] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.418663] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.424292] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.424420] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 170e7804-bd59-4b8d-a494-3a73bf406102 is going to be deleted. [ 1519.425366] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.425583] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.467022] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.467291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.472795] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.472943] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92093753-0a5b-4859-8d42-30b3241d5251 is going to be deleted. [ 1519.473908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.474165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.529504] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.529698] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c8bca44-f080-48fc-9d94-91ea357c71c7 is going to be deleted. [ 1519.530620] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.530849] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.530946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.531093] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e055f6e8-5bdf-4d73-ac15-366894643fcc" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.531265] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.531431] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.531514] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.531633] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d569034b-409c-4fd2-a968-3cd540fb405e" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.532224] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.532396] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.532526] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.532680] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f87de95f-23bb-4bc4-a0d9-8c1ba39407ad" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.538715] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.538908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.538908] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.539129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.539221] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.539340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-170e7804-bd59-4b8d-a494-3a73bf406102" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.558289] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.558505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.558505] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.558723] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.558852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.558999] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546f1ff4-ef91-4671-86b3-d15ea6055715" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.774264] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.774500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.774500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.774655] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.774825] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.774928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.774994] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.775161] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.775245] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.775329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.775415] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1519.795522] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.795713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.795713] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.795867] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.795958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.796087] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92093753-0a5b-4859-8d42-30b3241d5251" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.811823] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.812037] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.812085] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.812276] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.812367] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.812611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c8bca44-f080-48fc-9d94-91ea357c71c7" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.816928] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.817098] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.817158] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.817321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.819037] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.819170] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.819848] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.819946] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.820626] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.820722] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.821807] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.821934] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.822966] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.823067] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.824556] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.824676] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.825490] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.825598] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.826330] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.826471] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.827027] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1519.827541] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.827649] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.841711] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1519.842360] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.842503] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.843293] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1519.843741] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.843856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1519.880162] env[65427]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1519.880737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.880869] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2caa26d9-b324-42d2-886a-42215d3c4faf is going to be deleted. [ 1519.881800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.882030] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.929576] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.929766] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e21c17b3-5a69-411a-ae70-4a3d9c8d81a8 is going to be deleted. [ 1519.930762] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.930984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.968392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.968608] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c28844ee-3d37-4737-8b1e-d75a401be9a9 is going to be deleted. [ 1519.969462] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.969675] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.993897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.994096] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7abbe624-4b85-4277-bdd0-ed749e166fc9 is going to be deleted. [ 1519.994935] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1519.995165] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1519.996744] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1519.996888] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.016543] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.016716] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4c70605-cf21-41b4-b935-773c9e9944e5 is going to be deleted. [ 1520.017893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.017893] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.036167] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.036391] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.039771] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.039957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.047354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.047500] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f47490-5211-4c8e-9e0a-b7d44c25960f is going to be deleted. [ 1520.048359] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.048595] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.057170] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.057330] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.076480] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.076629] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e65cad1-7b76-434e-8bda-983c5b0b7e56 is going to be deleted. [ 1520.077538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.077756] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.091446] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.091634] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.140187] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.140386] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b is going to be deleted. [ 1520.141305] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.141531] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.193746] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.193941] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de73072-1420-4348-9a8f-7aea1d3f3f89 is going to be deleted. [ 1520.194772] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.194989] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.216107] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.216341] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.223945] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.224168] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.228339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.228496] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f63122d-80d5-406e-9516-33dde99d684a is going to be deleted. [ 1520.229418] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.229628] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.280092] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.280517] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.282607] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1520.284870] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.285030] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974a55e0-fc07-407b-9d34-07e598ec3f15 is going to be deleted. [ 1520.286063] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.286209] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.339329] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.339510] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f440566-de23-4d5d-b5b9-fdddf6cee691 is going to be deleted. [ 1520.340479] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.340725] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.340826] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.340960] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2caa26d9-b324-42d2-886a-42215d3c4faf" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.341143] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.341309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.341392] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.341513] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e21c17b3-5a69-411a-ae70-4a3d9c8d81a8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.342102] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.342269] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.342354] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.342472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c28844ee-3d37-4737-8b1e-d75a401be9a9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.342626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.342775] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.342852] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.342968] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7abbe624-4b85-4277-bdd0-ed749e166fc9" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.343119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.343260] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.343336] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.343451] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4c70605-cf21-41b4-b935-773c9e9944e5" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.343578] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.343730] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.343810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.343928] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f47490-5211-4c8e-9e0a-b7d44c25960f" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.344073] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.344212] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.344287] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.344402] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e65cad1-7b76-434e-8bda-983c5b0b7e56" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.344529] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.344667] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.344739] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.344847] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddaa9b4f-d3df-43e2-b55c-28b3c3da7d9b" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.350374] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.350568] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.350615] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.350761] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.350845] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.350957] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de73072-1420-4348-9a8f-7aea1d3f3f89" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.364140] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.364337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.364337] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.364524] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.364613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.364728] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f63122d-80d5-406e-9516-33dde99d684a" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.401198] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.401422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.401422] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.401621] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.401715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.401834] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974a55e0-fc07-407b-9d34-07e598ec3f15" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.454353] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.454567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.454567] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.454777] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.454869] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.454992] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f440566-de23-4d5d-b5b9-fdddf6cee691" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.789464] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9bc56a-e8fc-4868-ba33-8748f21e2376: rpc.has_security_group_logging(os_id): False [ 1520.808537] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.808760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.808760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.808938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.827792] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.828086] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.828236] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.828309] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.828500] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.828582] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.828674] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1520.888319] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.888562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.888562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.888737] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.888884] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.906074] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1522.925801] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1522.926214] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.240424] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.240796] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.241307] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.241970] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.243094] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.243497] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1539.244677] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.245070] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.246330] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.246330] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1549.246975] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.247498] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1554.248752] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.249157] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.250661] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.250661] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1564.252026] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.252439] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.253356] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.253356] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.254062] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.254445] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.255245] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.255245] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.256700] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.257100] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.257692] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.257692] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.259311] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.259662] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.260938] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.261347] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.704351] env[65427]: INFO networking_nsxv3.common.synchronization [req-e99d328a-9872-4a77-b174-a12174d1d848 req-89513d0d-5ae5-459d-85fb-7bd7d6d1f75e tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1603.704895] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1603.705592] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.705592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.705592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.705592] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.705830] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1603.705909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1603.705909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1603.706119] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1603.706176] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1603.706230] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1604.208520] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.208745] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.208803] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.208993] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.209108] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.209315] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.209413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.209476] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.209631] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.209719] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.209816] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1604.403492] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1604.403492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1604.403492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1604.403492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1604.403492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.411688] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1606.435720] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1606.436113] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 deletion is rescheduled due to dependency. [ 1606.436268] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.706384] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.706787] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.405019] env[65427]: INFO networking_nsxv3.common.synchronization [req-e4963344-e7ed-4cfa-999e-eab6bf102ce0 req-cd3e90a9-0c25-4a39-91e3-4c8c65ca4708 tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1612.405019] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1612.405019] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.405019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.405019] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.405459] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.405459] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.405538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.405538] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.405731] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.405796] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.405851] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.702491] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.702695] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.702906] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.703277] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.703618] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.703819] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.703969] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.704209] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.704357] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.704566] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1612.704677] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1612.704784] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1612.704894] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1612.705035] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1612.705146] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1612.705278] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1612.726675] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1612.726907] env[65427]: DEBUG dogpile.cache.region [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1612.727039] env[65427]: DEBUG dogpile.lock [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1612.727233] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.727543] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock port-4ff021af-980a-460d-8313-41d11df790e8 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.727712] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.727857] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.728171] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.728341] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff021af-980a-460d-8313-41d11df790e8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1612.908449] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.908839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.908839] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.908985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.908985] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.909190] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.909281] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.909339] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.909487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.909564] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.909668] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1612.937221] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1612.937449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1612.937449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1612.937618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1612.937757] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1612.947455] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1613.231217] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.231431] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.231483] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.231765] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.231922] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.232087] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Segment Port 4ff021af-980a-460d-8313-41d11df790e8 not found, creating... [ 1613.232359] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.232514] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.232629] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.232853] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.232995] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.233328] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.233486] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.233608] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.233816] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.233953] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.234112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Resource: SegmentPort with ID: 4ff021af-980a-460d-8313-41d11df790e8 is going to be created. [ 1613.253456] env[65427]: DEBUG networking_nsxv3.common.locking [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.253689] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.253767] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.254036] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.254266] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.254477] env[65427]: DEBUG oslo_concurrency.lockutils [None req-cdbb7f5c-7ebb-4e07-b377-b29c4f1d61bf None None] Releasing lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1613.929249] env[65427]: INFO networking_nsxv3.common.synchronization [req-e4963344-e7ed-4cfa-999e-eab6bf102ce0 req-fd65f589-f4d1-4b9c-998c-6abc96869c34 service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1613.929516] env[65427]: INFO networking_nsxv3.common.synchronization [req-e4963344-e7ed-4cfa-999e-eab6bf102ce0 req-fd65f589-f4d1-4b9c-998c-6abc96869c34 service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1613.929567] env[65427]: INFO networking_nsxv3.common.synchronization [req-e4963344-e7ed-4cfa-999e-eab6bf102ce0 req-fd65f589-f4d1-4b9c-998c-6abc96869c34 service nova] Enqueued Resource ID: 4ff021af-980a-460d-8313-41d11df790e8 with Priority: HIGHEST for action port [ 1613.930101] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1613.930236] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1613.930333] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff021af-980a-460d-8313-41d11df790e8 with Priority: HIGHEST for action port [ 1613.930614] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.930741] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.930814] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.931182] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.931319] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1613.932623] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.932856] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.933984] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff021af-980a-460d-8313-41d11df790e8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1613.933984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1613.933984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1613.933984] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1613.933984] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff021af-980a-460d-8313-41d11df790e8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1614.433637] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.433848] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.436112] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ff021af-980a-460d-8313-41d11df790e8 with status ACTIVE [ 1614.436309] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.436487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.436487] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.436702] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.436797] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.436980] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.437148] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.437231] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.437401] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.437484] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.437690] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.437909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.437909] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.438021] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.438055] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.438150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ff021af-980a-460d-8313-41d11df790e8 is going to be updated. [ 1614.460588] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.460800] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.460851] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.461035] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.461190] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.461340] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.956786] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1614.957179] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 deletion is rescheduled due to dependency. [ 1614.957179] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.957315] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.957520] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.957708] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1614.957824] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1614.957889] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1614.958064] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1614.958175] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.958274] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.460994] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1615.963611] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1616.465685] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.465846] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.465952] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.466177] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.466272] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.466383] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1616.493165] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1616.493423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1616.493423] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1616.493666] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1616.493720] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1616.502240] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1618.513439] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1618.513820] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.513930] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.514171] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.514443] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1618.514630] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1618.514721] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1618.514897] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1618.514979] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.515080] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1618.515170] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1618.931765] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.931981] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1619.017841] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.520284] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9bc56a-e8fc-4868-ba33-8748f21e2376: rpc.has_security_group_logging(os_id): False [ 1619.537434] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.537735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.537735] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.537854] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.537932] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.538203] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.538311] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.538375] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.538535] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.538614] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.538720] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1619.595578] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.595810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.595810] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.595938] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.596106] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.611429] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1621.626213] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1621.626611] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1623.932921] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.933313] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.934115] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.934512] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1633.935849] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1633.936251] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1638.937577] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1638.937975] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.939375] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1643.939818] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1648.940613] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1648.941035] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1653.942035] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1653.942485] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1658.943731] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1658.943731] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1663.944427] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1663.944802] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1668.946024] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1668.946441] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1673.947375] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1673.947777] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1678.948646] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1678.948646] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1683.950084] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1683.950498] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1685.172235] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.172597] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.172597] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.172809] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.173073] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.173236] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.173354] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.173578] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.173728] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.173932] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1685.174056] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] NeedRegenerationException {{(pid=65427) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1685.174166] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] no value, waiting for create lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1685.174280] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] value creation lock acquired {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1685.174388] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] No value present for key: 'zone-id' {{(pid=65427) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1685.174492] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Calling creation function for not-yet-present value {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1685.174623] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1685.200099] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1685.200287] env[65427]: DEBUG dogpile.cache.region [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65427) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1685.200412] env[65427]: DEBUG dogpile.lock [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Released creation lock {{(pid=65427) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1685.200585] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "network-785" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.200893] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock port-4ff021af-980a-460d-8313-41d11df790e8 taken with stack trace [, , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.201085] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.201210] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.201462] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.201600] env[65427]: DEBUG networking_nsxv3.api.rpc [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff021af-980a-460d-8313-41d11df790e8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1685.704673] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.704976] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.705059] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.705345] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.705496] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.705814] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.705968] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.706101] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.706328] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.706467] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.706753] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.706910] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.707042] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.707282] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.707423] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.707565] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Resource: SegmentPort with ID: 4ff021af-980a-460d-8313-41d11df790e8 is going to be updated. [ 1685.728765] env[65427]: DEBUG networking_nsxv3.common.locking [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.728975] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1685.729158] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1685.729414] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1685.729611] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1685.729823] env[65427]: DEBUG oslo_concurrency.lockutils [None req-71e901a5-17c1-4187-a318-80ed1bd7152d None None] Releasing lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.415541] env[65427]: INFO networking_nsxv3.common.synchronization [req-d36aadde-77be-4c41-a8dd-d0f8db7603e4 req-8026a2df-4c21-43ec-8e5f-ba31f855b726 service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1686.415819] env[65427]: INFO networking_nsxv3.common.synchronization [req-d36aadde-77be-4c41-a8dd-d0f8db7603e4 req-8026a2df-4c21-43ec-8e5f-ba31f855b726 service nova] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1686.415918] env[65427]: INFO networking_nsxv3.common.synchronization [req-d36aadde-77be-4c41-a8dd-d0f8db7603e4 req-8026a2df-4c21-43ec-8e5f-ba31f855b726 service nova] Enqueued Resource ID: 4ff021af-980a-460d-8313-41d11df790e8 with Priority: HIGHEST for action port [ 1686.416417] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_rules [ 1686.416600] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1686.416707] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff021af-980a-460d-8313-41d11df790e8 with Priority: HIGHEST for action port [ 1686.416998] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.417150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.417220] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.417421] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.417502] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.420411] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.420546] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.420613] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.420789] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.420943] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.421046] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.421115] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.421248] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.421334] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.421420] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.422214] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff021af-980a-460d-8313-41d11df790e8 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.422291] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.422357] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.423310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.423310] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff021af-980a-460d-8313-41d11df790e8',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.924191] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.925310] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.925440] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.925575] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ff021af-980a-460d-8313-41d11df790e8 with status ACTIVE [ 1686.925738] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.925872] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.925977] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.926205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.926295] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.926468] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.926562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.926618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.926760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.926833] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.927463] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.927606] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.927674] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.927827] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.928053] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.928150] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ff021af-980a-460d-8313-41d11df790e8 is going to be updated. [ 1686.949268] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.949492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1686.949492] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1686.949697] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1686.949799] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1686.949951] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff021af-980a-460d-8313-41d11df790e8" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.431068] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1687.933247] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.933472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.933472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.933693] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.933821] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.933862] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1687.967212] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1687.967473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1687.967473] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1687.967690] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1687.967837] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1687.976950] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1689.989117] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1689.989496] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.989626] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.989859] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.990182] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1689.990342] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1689.990413] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1689.990618] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1689.990715] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.990825] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1689.990919] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1690.493187] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1690.996334] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9bc56a-e8fc-4868-ba33-8748f21e2376: rpc.has_security_group_logging(os_id): False [ 1691.017816] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.018074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.018074] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.018310] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.018449] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.018773] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.018892] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.018958] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.019129] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.019205] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.019295] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1691.086938] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.087150] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.087208] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.087562] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.087771] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.103706] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1691.417649] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.417899] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1693.120220] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1693.120670] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1696.419148] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.419557] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.421354] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.421699] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.587631] env[65427]: INFO networking_nsxv3.common.synchronization [req-fbf1ab92-48a3-4d2d-ac83-ba93ab62983e req-96645a85-26ac-4695-9cc0-679fa902b71d tempest-ServerActionsTestOtherB-963575078 tempest-ServerActionsTestOtherB-963575078-project-member] Enqueued Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1701.588534] env[65427]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 with Priority: HIGHEST for action security_group_members [ 1701.588534] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9bc56a-e8fc-4868-ba33-8748f21e2376 taken with stack trace [, , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1701.588660] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1701.588705] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1701.588907] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1701.589084] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1701.589218] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1701.589306] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1701.589472] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1701.589561] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1701.589680] env[65427]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9bc56a-e8fc-4868-ba33-8748f21e2376',) {} {{(pid=65427) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1702.092083] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.092321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1702.092321] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1702.092547] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1702.092643] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1702.092851] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.092966] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1702.093083] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1702.093210] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1702.093257] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1702.093312] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 is going to be updated. [ 1702.120533] env[65427]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65427) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1702.120760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1702.120760] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1702.120923] env[65427]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1702.121076] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1702.129587] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: IN_PROGRESS for 2s [ 1704.141882] env[65427]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 in Status: SUCCESS [ 1704.142411] env[65427]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9bc56a-e8fc-4868-ba33-8748f21e2376 deletion is rescheduled due to dependency. [ 1704.142411] env[65427]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9bc56a-e8fc-4868-ba33-8748f21e2376" {{(pid=65427) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1706.589966] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.590384] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.590951] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.591322] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.592160] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.592603] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.593353] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.593785] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1726.595410] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.595798] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1727.274360] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1727.274518] env[65427]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-30aee898-ae2e-4668-8293-08c4c2aa41cb None None] NSXv3 Agent Agent loop - iteration:5 started [ 1731.598271] env[65427]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1731.598637] env[65427]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0